-- Logs begin at Fri 2022-01-21 08:40:50 UTC, end at Fri 2022-01-21 09:52:36 UTC. -- Jan 21 09:26:49.497346 dv-cinder-804035-25-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jan 21 09:26:49.506340 dv-cinder-804035-25-iscsi devstack@n-api.service[102440]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jan 21 09:26:49.508332 dv-cinder-804035-25-iscsi devstack@n-api.service[102440]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Jan 21 09:26:49 2022] *** Jan 21 09:26:49.508332 dv-cinder-804035-25-iscsi devstack@n-api.service[102440]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jan 21 09:26:49.508332 dv-cinder-804035-25-iscsi devstack@n-api.service[102440]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jan 21 09:26:49.508332 dv-cinder-804035-25-iscsi devstack@n-api.service[102440]: nodename: dv-cinder-804035-25-iscsi Jan 21 09:26:49.508332 dv-cinder-804035-25-iscsi devstack@n-api.service[102440]: machine: x86_64 Jan 21 09:26:49.508332 dv-cinder-804035-25-iscsi devstack@n-api.service[102440]: clock source: unix Jan 21 09:26:49.508332 dv-cinder-804035-25-iscsi devstack@n-api.service[102440]: pcre jit disabled Jan 21 09:26:49.508332 dv-cinder-804035-25-iscsi devstack@n-api.service[102440]: detected number of CPU cores: 4 Jan 21 09:26:49.508332 dv-cinder-804035-25-iscsi devstack@n-api.service[102440]: current working directory: / Jan 21 09:26:49.508332 dv-cinder-804035-25-iscsi devstack@n-api.service[102440]: detected binary path: /usr/bin/uwsgi-core Jan 21 09:26:49.508915 dv-cinder-804035-25-iscsi devstack@n-api.service[102440]: your processes number limit is 47680 Jan 21 09:26:49.508915 dv-cinder-804035-25-iscsi devstack@n-api.service[102440]: your memory page size is 4096 bytes Jan 21 09:26:49.508915 dv-cinder-804035-25-iscsi devstack@n-api.service[102440]: detected max file descriptor number: 2048 Jan 21 09:26:49.508915 dv-cinder-804035-25-iscsi devstack@n-api.service[102440]: lock engine: pthread robust mutexes Jan 21 09:26:49.508915 dv-cinder-804035-25-iscsi devstack@n-api.service[102440]: thunder lock: enabled Jan 21 09:26:49.508915 dv-cinder-804035-25-iscsi devstack@n-api.service[102440]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jan 21 09:26:49.508915 dv-cinder-804035-25-iscsi devstack@n-api.service[102440]: Python version: 3.8.10 (default, Nov 26 2021, 20:14:08) [GCC 9.3.0] Jan 21 09:26:49.553758 dv-cinder-804035-25-iscsi devstack@n-api.service[102440]: Python main interpreter initialized at 0x556743d9f9c0 Jan 21 09:26:49.553758 dv-cinder-804035-25-iscsi devstack@n-api.service[102440]: python threads support enabled Jan 21 09:26:49.553758 dv-cinder-804035-25-iscsi devstack@n-api.service[102440]: your server socket listen backlog is limited to 100 connections Jan 21 09:26:49.553758 dv-cinder-804035-25-iscsi devstack@n-api.service[102440]: your mercy for graceful operations on workers is 90 seconds Jan 21 09:26:49.554239 dv-cinder-804035-25-iscsi devstack@n-api.service[102440]: mapped 403077 bytes (393 KB) for 2 cores Jan 21 09:26:49.554239 dv-cinder-804035-25-iscsi devstack@n-api.service[102440]: *** Operational MODE: preforking *** Jan 21 09:26:49.554546 dv-cinder-804035-25-iscsi devstack@n-api.service[102440]: *** uWSGI is running in multiple interpreter mode *** Jan 21 09:26:49.554546 dv-cinder-804035-25-iscsi devstack@n-api.service[102440]: spawned uWSGI master process (pid: 102440) Jan 21 09:26:49.554809 dv-cinder-804035-25-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jan 21 09:26:49.558920 dv-cinder-804035-25-iscsi devstack@n-api.service[102440]: spawned uWSGI worker 1 (pid: 102441, cores: 1) Jan 21 09:26:49.558920 dv-cinder-804035-25-iscsi devstack@n-api.service[102440]: spawned uWSGI worker 2 (pid: 102442, cores: 1) Jan 21 09:26:49.558920 dv-cinder-804035-25-iscsi devstack@n-api.service[102440]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jan 21 09:26:51.448579 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 21 09:26:51.448579 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: from cryptography.utils import int_from_bytes Jan 21 09:26:51.449303 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 21 09:26:51.449303 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: from cryptography.utils import int_from_bytes Jan 21 09:26:51.470123 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 21 09:26:51.470123 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: from cryptography.utils import int_from_bytes Jan 21 09:26:51.471802 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 21 09:26:51.471802 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: from cryptography.utils import int_from_bytes Jan 21 09:26:54.081980 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jan 21 09:26:54.082626 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jan 21 09:26:54.082772 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jan 21 09:26:54.083137 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jan 21 09:26:54.083396 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jan 21 09:26:54.083871 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:26:54.084218 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:26:54.084543 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:26:54.084866 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:26:54.085226 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:26:54.085544 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:26:54.085869 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:26:54.086193 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:26:54.086523 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:26:54.086794 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:26:54.087010 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jan 21 09:26:54.087403 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:26:54.087499 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jan 21 09:26:54.087579 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-804035-25-iscsi {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:26:54.087740 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:26:54.087826 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jan 21 09:26:54.088051 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:26:54.088148 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jan 21 09:26:54.088367 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:26:54.088463 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jan 21 09:26:54.088693 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:26:54.088780 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:26:54.089003 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:26:54.089095 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:26:54.089354 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:26:54.089452 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:26:54.089667 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:26:54.089777 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:26:54.090047 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:26:54.090169 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:26:54.090375 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:26:54.090616 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:26:54.090722 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:26:54.090929 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:26:54.091030 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:26:54.091247 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:26:54.091345 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:26:54.091586 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:26:54.091694 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:26:54.091905 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:26:54.091995 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:26:54.092222 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:26:54.092321 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-804035-25-iscsi {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:26:54.092546 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:26:54.092653 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:26:54.092857 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:26:54.093012 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:26:54.093206 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:26:54.093297 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:26:54.093522 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:26:54.093643 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:26:54.093837 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:26:54.093936 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-804035-25-iscsi {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:26:54.094167 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:26:54.094308 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:26:54.094483 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:26:54.094571 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:26:54.094839 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:26:54.094996 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:26:54.095258 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:26:54.095353 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:26:54.095573 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:26:54.095703 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:26:54.095885 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:26:54.095979 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:26:54.096210 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:26:54.096304 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:26:54.096549 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:26:54.096693 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:26:54.096852 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:26:54.096994 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:26:54.097271 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:26:54.097409 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:26:54.097564 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:26:54.097680 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:26:54.097980 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:26:54.098112 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:26:54.098258 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:26:54.098367 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:26:54.098530 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:26:54.098634 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-804035-25-iscsi {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:26:54.098799 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:26:54.098877 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:26:54.099115 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:26:54.099222 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:26:54.099439 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:26:54.099536 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:26:54.099751 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:26:54.099864 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:26:54.100098 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:26:54.100251 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:26:54.100343 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:26:54.100477 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:26:54.100614 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:26:54.100795 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:26:54.100944 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:26:54.101126 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:26:54.101297 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:26:54.101466 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:26:54.101627 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:26:54.101814 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:26:54.101914 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:26:54.102125 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:26:54.102212 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:26:54.102451 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:26:54.102537 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:26:54.102816 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:26:54.102925 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:26:54.103086 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:26:54.103172 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:26:54.103395 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:26:54.103480 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:26:54.103708 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:26:54.103803 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:26:54.104017 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:26:54.104109 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:26:54.104329 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:26:54.104415 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:26:54.104636 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:26:54.104722 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:26:54.104893 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:26:54.104980 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:26:54.105233 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:26:54.105323 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:26:54.105565 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:26:54.105659 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:26:54.105881 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:26:54.105967 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:26:54.106208 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:26:54.106294 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:26:54.106462 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:26:54.106555 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:26:54.106720 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:26:54.106828 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:26:54.107045 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:26:54.107230 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.45 {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:26:54.107376 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:26:54.107486 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.45 {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:26:54.107693 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:26:54.107799 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:26:54.108007 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:26:54.108144 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:26:54.108320 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:26:54.108475 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:26:54.108633 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:26:54.108790 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:26:54.108946 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:26:54.109113 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:26:54.109284 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:26:54.109462 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:26:54.109601 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:26:54.109776 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:26:54.109916 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:26:54.110088 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:26:54.110259 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:26:54.110400 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:26:54.110559 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:26:54.110726 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:26:54.110887 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:26:54.111066 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:26:54.111201 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:26:54.111374 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:26:54.111526 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:26:54.111620 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:26:54.111922 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:26:54.112008 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.45 {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:26:54.112178 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.45 {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:26:54.112274 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:26:54.112493 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:26:54.112579 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:26:54.112838 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:26:54.112925 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:26:54.113164 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:26:54.113253 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:26:54.114137 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:26:54.114250 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:26:54.114538 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:26:54.114657 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:26:54.114955 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:26:54.115105 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:26:54.115276 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:26:54.115365 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:26:54.115632 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:26:54.115720 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:26:54.115948 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:26:54.116067 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:26:54.116259 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:26:54.116382 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:26:54.116576 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:26:54.116697 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:26:54.116891 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:26:54.117104 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:26:54.117273 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:26:54.117469 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:26:54.117594 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:26:54.117706 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:26:54.117812 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:26:54.117915 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:26:54.118087 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:26:54.118210 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:26:54.118403 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:26:54.118498 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:26:54.118717 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:26:54.118849 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:26:54.119032 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:26:54.119146 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:26:54.119340 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:26:54.119428 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:26:54.119655 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:26:54.119749 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:26:54.119964 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:26:54.120059 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:26:54.120522 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:26:54.120619 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:26:54.120835 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:26:54.120930 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:26:54.121168 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:26:54.121265 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:26:54.121481 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:26:54.121567 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:26:54.121792 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:26:54.121873 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:26:54.122106 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:26:54.122188 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:26:54.122416 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:26:54.122490 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:26:54.122736 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:26:54.122811 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:26:54.123044 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:26:54.123126 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:26:54.123384 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:26:54.123511 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:26:54.123663 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:26:54.123757 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:26:54.123974 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:26:54.124070 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:26:54.124284 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:26:54.124394 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:26:54.124591 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:26:54.124667 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:26:54.124908 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:26:54.125028 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:26:54.125234 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:26:54.125314 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:26:54.125553 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:26:54.125634 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:26:54.125862 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:26:54.125939 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:26:54.126170 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:26:54.126252 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:26:54.126474 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:26:54.126561 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:26:54.126795 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:26:54.126869 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:26:54.127105 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:26:54.127178 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:26:54.127420 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:26:54.127522 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:26:54.127726 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:26:54.127812 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:26:54.128037 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:26:54.128131 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:26:54.128357 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:26:54.128456 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:26:54.128670 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:26:54.128764 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.129069 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:26:54.129721 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.129903 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:26:54.130077 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.130220 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:26:54.130401 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.130535 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:26:54.130741 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.130951 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:26:54.131080 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.131257 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:26:54.131408 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.131577 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:26:54.131727 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.131885 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:26:54.132046 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.132212 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:26:54.132378 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.132529 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:26:54.132698 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.132846 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:26:54.133015 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.133188 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:26:54.133359 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.133506 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:26:54.133682 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.133835 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:26:54.134003 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.134183 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.134336 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.134524 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.134659 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.134877 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.134965 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.135201 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.135288 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.135542 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.135643 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.135882 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.135970 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.136208 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.136302 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.136529 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.136629 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.136845 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.136940 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.137195 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.137286 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.137520 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.137618 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.137839 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.137935 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.138161 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.138248 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.138475 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.138571 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.138795 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.138881 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.139118 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.139225 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.139434 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.139603 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.139752 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.139841 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.140076 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.140163 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.140391 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.140480 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.140706 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.140801 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.141077 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.141190 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.141389 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.141479 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.141707 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.141801 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.142017 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.142105 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.142328 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.142417 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.142638 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.142726 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.142955 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.143052 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.143264 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.143353 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.143589 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.143677 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.143920 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.144017 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.144232 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.144319 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.144711 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.145062 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.145755 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.146373 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.146472 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.146561 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.146643 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.146731 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.146819 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.146909 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.146991 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.147079 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.147160 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.147241 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.147331 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.147421 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.147509 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.147589 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.147668 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.147748 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.147932 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.148022 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.148247 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.148342 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.148578 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.148671 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.148915 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.149010 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.149259 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.149372 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.149583 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.149678 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.149900 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.149988 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.150213 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.150299 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.150531 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.150625 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.150846 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.150934 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.151186 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.151287 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.151474 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.151574 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.151790 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.151879 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.152107 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.152194 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.152435 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.152529 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.152748 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.152836 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.153066 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.153204 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.153403 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.153506 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.153720 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.153814 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.154029 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.154117 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.154338 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.154436 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.154649 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.154737 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.154963 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.155050 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.155274 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.155363 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.155587 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.155674 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.155897 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.155983 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.156207 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.156302 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.156519 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.156606 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.156845 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.156940 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.157176 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.157279 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.157490 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.157578 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.157799 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.157893 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.158107 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.158202 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.158428 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.158514 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.158742 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.158838 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.159054 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.159141 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.159369 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.159470 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.159687 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.159784 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.160002 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.160090 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.160391 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.160885 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.160885 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.161050 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.161154 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.161385 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.161488 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.161585 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.161711 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.161808 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.162028 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.162117 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.162354 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.162445 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.162671 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.162768 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.162981 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.163067 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.163300 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.163394 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.163634 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.163731 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.163985 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.164074 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.164312 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.164398 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.164623 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.164754 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.164943 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.165031 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.165297 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.165387 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.165626 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.165717 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.165948 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.166042 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.166270 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.166365 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.166583 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.166670 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.166901 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.166987 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.167213 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.167307 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.167528 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.167615 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.167842 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.167929 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.168155 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.168250 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.168478 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.168565 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.168795 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.168880 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.169114 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.169362 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.169494 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.169577 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.169759 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.169858 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.170072 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.170173 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.170397 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.170484 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.170708 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.170811 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.171027 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.171122 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.171364 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.171489 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.171680 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.171774 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.171997 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.172085 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.172312 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.172397 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.172630 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.172716 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.172944 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.173031 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.173283 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.173386 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.173601 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.173689 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.173914 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.174003 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.174225 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.174320 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.174541 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.174637 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.174854 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.174938 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.175168 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.175254 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.175479 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.175573 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.176293 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.176449 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.176975 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.177081 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.177232 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.177408 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.177498 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.177738 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.177888 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.178069 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.178364 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.178468 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.178692 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.178859 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.179013 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.179283 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.179381 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.179609 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.179697 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.179928 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.180015 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.180251 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.180348 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.180564 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.180651 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.180878 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.180965 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.181218 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.181321 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.181545 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.181686 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.181857 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.181993 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.182167 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.182311 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.182475 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.182621 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.182790 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.182947 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.183120 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.183218 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.183431 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.183518 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.183755 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.183842 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.184081 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.184168 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.184392 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.184479 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.184705 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.184793 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.185016 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.185223 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.185372 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.185508 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.185647 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.185783 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.185958 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.186096 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.186269 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.186407 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.186618 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.186768 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.186939 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.187078 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.187249 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.187385 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.187566 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.187715 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.187893 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.188030 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.188205 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.188342 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.188521 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.188690 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.188837 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.188974 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.189112 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.189278 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.189455 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.189598 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.189781 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.189870 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.190099 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.190359 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.190447 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.190691 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.190782 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.191010 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.191098 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.191324 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.191444 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.192261 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.192449 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.192587 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.192873 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.192978 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.193236 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.193329 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.193566 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.193662 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.193874 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.193969 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.194190 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.194279 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.194508 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.194628 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.194820 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.195080 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.195191 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.195424 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.195521 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.195729 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.195824 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.196038 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.196136 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.196355 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.196450 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.196666 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.196761 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.196976 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.197079 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.197340 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.197436 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.197653 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.197758 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.197968 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.198118 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.198275 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.198368 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.198587 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.198689 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.198892 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.198988 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.199210 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.199297 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.199523 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.199610 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.199833 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.199944 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.200171 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.200274 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.200434 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.200523 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.200740 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.200834 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.201057 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.201166 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.201420 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.201517 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.201734 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.201831 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.202057 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.202178 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.202373 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.202480 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.202682 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.202778 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.202991 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.203077 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.203307 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.203406 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.203617 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.203714 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.203925 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.204019 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.204236 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.204324 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.204546 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.204643 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.204851 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.204938 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.205185 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.205276 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.205505 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.205606 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.205822 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.205910 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.206173 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.206269 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.206490 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.206606 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.206802 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.206897 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.207178 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.207312 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.207709 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.207811 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.207927 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.208015 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.208239 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.208337 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.208551 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.208640 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.208868 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.208957 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.209209 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.209313 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.209523 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.209618 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.209845 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.209967 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.210157 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.210272 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.210477 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.210576 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.210788 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.210934 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.211081 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.211228 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.211423 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.211577 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.211710 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.211849 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.212010 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.212163 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.212320 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.212460 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.212596 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.212732 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.212919 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.213058 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.213255 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.213400 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.213566 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.213699 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.213876 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.214030 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.214166 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.214301 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.214477 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.214621 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.214787 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.214926 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.215099 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.215252 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.215400 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.215532 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.215708 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.215846 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.216021 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.216166 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.216311 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.216495 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.216639 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.216776 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.216911 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.217048 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.218193 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.218389 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.218488 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.218561 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.218645 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.218722 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.218790 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.218790 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.219058 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.219452 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.219546 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.219780 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.219873 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.220107 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.220203 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.220417 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.220510 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.220728 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.220830 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.221057 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.221170 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.221402 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.221632 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.221733 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.221811 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.222012 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.222098 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.222326 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.222421 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.222643 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.222785 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.223024 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.223137 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.223337 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.223438 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.223649 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.223756 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.223962 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.224053 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.224277 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.224377 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.224610 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.224716 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.224928 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.225026 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.225263 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.225373 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.225573 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.225669 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.225877 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.225965 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.226200 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.226286 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.226516 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.226613 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.226840 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.226935 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.227169 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.227256 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.227490 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.227578 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.227798 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.227892 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.228114 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.228209 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.228427 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.228522 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.228739 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.228834 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.229051 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.229220 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.229448 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.229607 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.229716 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.229803 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.230030 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.230207 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.230339 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.230425 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.230650 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.230737 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.230961 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.231056 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.231273 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.231359 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.231589 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.231675 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.231905 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.231999 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.232216 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.232302 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.232546 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.232640 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.232854 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.232942 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.233177 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.233301 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.233497 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.233584 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.233810 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.233898 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.234125 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.234209 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.234436 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.234535 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.234749 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.234876 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.235069 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.235193 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.235387 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.235529 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.235703 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.235791 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.236019 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.236105 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.236333 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.236428 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.236648 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.236735 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.236965 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.237051 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.237309 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.237411 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.237646 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.237733 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.237964 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.238050 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.238277 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.238905 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.239133 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.239379 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.239588 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.239737 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.239871 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.240105 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.240240 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.240487 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.240590 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.240803 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.240906 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.241116 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.241270 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.241448 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.241533 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.241754 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.241850 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.242069 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.242155 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.242376 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.242461 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.242697 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.242950 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.243050 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.243131 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.243420 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.243505 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.243731 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.243826 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.244044 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.244152 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.244363 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.244464 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.244675 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.244762 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.244986 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.245072 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.245580 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.245689 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.245914 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.246008 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.246226 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.246312 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.246537 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.246624 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.246849 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.246941 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.247179 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.247271 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.247489 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.247575 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.247817 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.247914 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.248147 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.248233 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.248459 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.248553 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.248788 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.248875 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.249113 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.249289 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.249473 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.249662 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.249810 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.249899 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.250227 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.250323 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.250555 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.250775 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.250913 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.251049 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.251189 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.251323 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.251488 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.251629 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.251801 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.251964 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.252114 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.252329 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.252538 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.252698 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.252849 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.252979 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.253207 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.253360 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.253445 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.253525 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.253655 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.253751 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.254594 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.254699 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.254892 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.254979 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.255226 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.255314 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.255599 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.255723 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.255910 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.255998 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.256238 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.256326 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.256548 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.256636 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.256876 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.256982 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.257217 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.257320 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.257545 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.257631 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.257867 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.257965 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.258174 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.258260 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.258486 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.258578 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.258802 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.258901 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.259110 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.259198 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.259418 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.259505 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.259725 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.259820 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.260040 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.260126 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.260354 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.260440 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.260668 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.260766 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.261003 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.261091 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.261339 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.261427 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.261664 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.261751 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.261999 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.262131 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.262312 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.262399 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.262626 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.262713 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.262942 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.263027 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.263267 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.263353 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.263579 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.263674 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.263884 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.263996 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.264199 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.264344 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.264499 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.264645 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.264800 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.264931 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.265109 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.265310 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.265447 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.265538 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.265758 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.265942 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.266090 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.266234 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.266373 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.266458 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.266668 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.266764 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.266973 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.267073 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.267300 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.267394 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.267613 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.267700 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.267921 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.268015 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.268229 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.268316 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.268534 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.268628 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.268875 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.268964 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.269200 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.269290 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.269596 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.269697 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.269911 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.270116 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.270238 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.270325 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.270550 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.270742 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.270920 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.271020 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.271166 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.271259 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.271486 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.271579 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.271788 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.271876 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.272112 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.272201 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.272425 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.272519 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.272736 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.272882 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.273054 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.273191 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.273390 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.273506 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.273707 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.273803 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.274028 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.274117 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.274344 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.274445 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.274665 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.274755 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.274992 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.275227 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.275316 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.275558 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.275647 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.275907 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.276029 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.276199 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.276361 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.276516 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.276604 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.276833 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.276922 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.277199 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.277303 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.277486 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.277573 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.277802 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.277896 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.278116 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.278211 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.278431 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.278516 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.278755 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.278841 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.279076 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.279170 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.279401 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.279488 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.279736 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.279963 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.280058 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.280301 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.280396 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.280625 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.280712 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.280956 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.281116 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.281301 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.281392 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.281625 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.281719 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.281945 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.282033 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.282259 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.282346 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.282575 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.282661 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.282891 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.282977 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.283207 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.283303 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.283519 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.283604 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.283838 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.283927 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.284157 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.284257 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.284470 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.284566 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.284787 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.284881 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.285106 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.285544 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.285630 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.285724 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.285807 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.285887 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.286109 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.286243 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.286433 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.286578 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.286750 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.286889 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.287074 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.287299 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.287452 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.287593 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.287790 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.287878 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.288109 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.288195 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.288427 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.288523 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.288749 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.288843 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.289069 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.289176 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.289430 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.289527 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.289749 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.289849 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.290070 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.290165 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.290391 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.290479 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.290706 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.290793 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.291023 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.291128 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.291339 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.291433 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.291650 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.291737 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.291977 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.292072 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.292295 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.292382 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.292605 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.292825 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.292942 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.293175 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.293314 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.293516 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.293777 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.293865 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.294130 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.294219 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.294451 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.294539 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.294783 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.294870 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.295114 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.295202 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.295429 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.295605 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.295743 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.295823 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.296059 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.296196 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.296367 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.296467 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.296681 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.296784 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.297028 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.297131 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.297341 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.297431 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.297651 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.297747 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.297984 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.298088 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.298278 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.298365 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.298592 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.298813 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.298909 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.299165 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.299260 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.299487 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.299573 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.299817 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.299904 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.300129 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.300216 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.300440 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.300535 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.300749 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.301421 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.301696 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.301796 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.302035 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.302132 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.302355 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.302449 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.302680 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.302766 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.303001 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.303096 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.303316 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.303403 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.303630 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.303717 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.303943 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.304038 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.304254 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.304341 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.304606 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.304705 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.304871 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.304965 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.305203 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.305293 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.305513 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.305598 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.305837 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.305925 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.306142 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.306287 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.306451 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.306538 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.306768 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.306865 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.307079 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.307167 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.307389 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.307483 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.307702 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.307789 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.308011 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.308097 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.308327 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.308422 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.308642 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.308736 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.308961 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.309203 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.309304 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.309599 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.309739 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.309909 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.309995 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.310227 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.310315 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.310538 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.310626 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.310870 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.310957 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.311182 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.311266 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.311490 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.311577 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.311813 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.311899 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.312127 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.312225 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.312444 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.312532 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.312759 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.312845 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.313071 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.313182 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.313416 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.313505 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.313732 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.313819 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.314049 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.314288 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.314377 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.314664 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.314750 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.314977 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.315077 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.315294 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.315389 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.315637 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.315723 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.315952 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.316140 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.316267 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.317044 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.317226 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.317368 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.317545 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.317698 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.317868 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.318015 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.318188 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.318333 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.318507 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.318652 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.318827 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.318967 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.319146 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.319289 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.319463 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.319624 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.319781 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.319943 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.320099 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.320253 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.320417 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.320686 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.320815 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.321002 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.321090 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.321348 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.321454 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.321675 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.321772 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.321988 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.322083 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.322312 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.322400 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.322639 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.322727 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.322956 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.323042 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.323277 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.323370 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.323589 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.323674 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.323904 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.323990 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.324310 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.324410 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.324568 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.324654 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.324886 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.324980 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.325215 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.325304 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.325527 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.325654 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.325835 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.325975 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.326147 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.326301 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.326484 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.326631 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.326862 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.326981 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.327149 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.327271 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.327467 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.327602 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.327778 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.327909 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.328103 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.328239 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.328421 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.328558 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.328744 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.328881 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.329066 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.329277 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.329405 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.329557 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.329721 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.329892 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.330054 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.330211 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.330369 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.330520 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.330686 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.330834 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.330998 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.331159 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.331314 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.331497 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.331628 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.331839 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.331946 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.332240 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.332337 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.332524 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.332613 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.332916 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.333002 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.333268 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.333355 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.333588 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.333722 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.333911 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.334004 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.334230 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.334326 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.334545 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.334639 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.334860 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.334945 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.335174 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.335269 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.335492 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.335585 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.335810 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.335927 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.336124 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.336244 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.336441 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.336553 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.336756 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.336852 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.337074 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.337188 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.337427 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.337515 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.337757 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.337845 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.338075 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.338166 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.338410 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.338498 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.338726 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.338827 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.339051 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.339140 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.339374 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.339463 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.339692 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.339781 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.340006 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.340094 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.340316 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.340416 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.340566 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jan 21 09:26:54.340664 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.340944 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.341287 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.341612 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.341939 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.342273 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.342607 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.342943 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.343279 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.343633 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.343956 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.344308 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.344645 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.344970 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.345380 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.345696 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:26:54.345945 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jan 21 09:26:54.363971 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG oslo_db.sqlalchemy.engines [None req-86f8b552-29b3-4816-8c5b-1660d32d7af2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102441) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 21 09:26:54.368821 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG oslo_db.sqlalchemy.engines [None req-cf10bc76-d132-4e24-8b5f-b9272c5d8889 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102442) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 21 09:26:54.428777 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.context [None req-86f8b552-29b3-4816-8c5b-1660d32d7af2 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),e6c51752-00e2-49a2-b378-b2153f241200(cell1) {{(pid=102441) load_cells /opt/stack/nova/nova/context.py:464}} Jan 21 09:26:54.432981 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG oslo_concurrency.lockutils [None req-86f8b552-29b3-4816-8c5b-1660d32d7af2 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:26:54.433587 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.context [None req-cf10bc76-d132-4e24-8b5f-b9272c5d8889 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),e6c51752-00e2-49a2-b378-b2153f241200(cell1) {{(pid=102442) load_cells /opt/stack/nova/nova/context.py:464}} Jan 21 09:26:54.434599 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG oslo_concurrency.lockutils [None req-86f8b552-29b3-4816-8c5b-1660d32d7af2 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:26:54.435398 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG oslo_concurrency.lockutils [None req-86f8b552-29b3-4816-8c5b-1660d32d7af2 None None] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:26:54.437348 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG oslo_concurrency.lockutils [None req-86f8b552-29b3-4816-8c5b-1660d32d7af2 None None] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:26:54.437739 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG oslo_concurrency.lockutils [None req-cf10bc76-d132-4e24-8b5f-b9272c5d8889 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102442) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:26:54.439336 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG oslo_concurrency.lockutils [None req-cf10bc76-d132-4e24-8b5f-b9272c5d8889 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102442) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:26:54.440161 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG oslo_concurrency.lockutils [None req-cf10bc76-d132-4e24-8b5f-b9272c5d8889 None None] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102442) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:26:54.442298 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG oslo_concurrency.lockutils [None req-cf10bc76-d132-4e24-8b5f-b9272c5d8889 None None] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102442) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:26:54.447657 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG oslo_db.sqlalchemy.engines [None req-86f8b552-29b3-4816-8c5b-1660d32d7af2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102441) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 21 09:26:54.448523 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG oslo_db.sqlalchemy.engines [None req-86f8b552-29b3-4816-8c5b-1660d32d7af2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102441) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 21 09:26:54.454704 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG oslo_db.sqlalchemy.engines [None req-cf10bc76-d132-4e24-8b5f-b9272c5d8889 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102442) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 21 09:26:54.458240 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG oslo_db.sqlalchemy.engines [None req-cf10bc76-d132-4e24-8b5f-b9272c5d8889 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102442) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 21 09:26:54.625563 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG oslo_db.sqlalchemy.engines [None req-cf10bc76-d132-4e24-8b5f-b9272c5d8889 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102442) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 21 09:26:54.630438 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG oslo_db.sqlalchemy.engines [None req-86f8b552-29b3-4816-8c5b-1660d32d7af2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102441) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 21 09:26:55.045123 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: WARNING keystonemiddleware.auth_token [None req-cf10bc76-d132-4e24-8b5f-b9272c5d8889 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 21 09:26:55.051647 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: WARNING keystonemiddleware.auth_token [None req-cf10bc76-d132-4e24-8b5f-b9272c5d8889 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 21 09:26:55.075857 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: WARNING keystonemiddleware.auth_token [None req-86f8b552-29b3-4816-8c5b-1660d32d7af2 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 21 09:26:55.082934 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: WARNING keystonemiddleware.auth_token [None req-86f8b552-29b3-4816-8c5b-1660d32d7af2 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 21 09:26:55.391351 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: WARNING keystonemiddleware.auth_token [None req-cf10bc76-d132-4e24-8b5f-b9272c5d8889 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 21 09:26:55.397228 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: WARNING keystonemiddleware.auth_token [None req-cf10bc76-d132-4e24-8b5f-b9272c5d8889 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 21 09:26:55.402484 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x556743d9f9c0 pid: 102442 (default app) Jan 21 09:26:55.404521 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi [None req-cf10bc76-d132-4e24-8b5f-b9272c5d8889 None None] Calling method '>' {{(pid=102442) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:26:55.405701 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: INFO nova.api.openstack.requestlog [None req-cf10bc76-d132-4e24-8b5f-b9272c5d8889 None None] 10.222.0.45 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001725 Jan 21 09:26:55.406122 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: [pid: 102442|app: 0|req: 1/1] 10.222.0.45 () {50 vars in 788 bytes} [Fri Jan 21 09:26:55 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 09:26:55.426583 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: WARNING keystonemiddleware.auth_token [None req-86f8b552-29b3-4816-8c5b-1660d32d7af2 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 21 09:26:55.431861 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: WARNING keystonemiddleware.auth_token [None req-86f8b552-29b3-4816-8c5b-1660d32d7af2 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 21 09:26:55.437165 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x556743d9f9c0 pid: 102441 (default app) Jan 21 09:28:27.515266 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi [None req-cf10bc76-d132-4e24-8b5f-b9272c5d8889 None None] Calling method '>' {{(pid=102442) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:28:27.516304 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: INFO nova.api.openstack.requestlog [None req-cf10bc76-d132-4e24-8b5f-b9272c5d8889 None None] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001480 Jan 21 09:28:27.517132 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: [pid: 102442|app: 0|req: 2/2] 10.222.0.45 () {54 vars in 930 bytes} [Fri Jan 21 09:28:27 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 09:28:27.973820 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi [None req-51328d07-3e28-4428-bb2e-26586860319c admin admin] Calling method '>' {{(pid=102441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:28:28.006418 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: INFO nova.api.openstack.requestlog [None req-51328d07-3e28-4428-bb2e-26586860319c admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.482336 Jan 21 09:28:28.007502 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: [pid: 102441|app: 0|req: 1/3] 10.222.0.45 () {60 vars in 1291 bytes} [Fri Jan 21 09:28:27 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:28:30.355921 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi [None req-cf10bc76-d132-4e24-8b5f-b9272c5d8889 None None] Calling method '>' {{(pid=102442) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:28:30.356918 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: INFO nova.api.openstack.requestlog [None req-cf10bc76-d132-4e24-8b5f-b9272c5d8889 None None] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001457 Jan 21 09:28:30.357508 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: [pid: 102442|app: 0|req: 3/4] 10.222.0.45 () {54 vars in 930 bytes} [Fri Jan 21 09:28:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 09:28:30.422983 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi [None req-f0617ecc-ba8a-4fad-872d-bfee81feacbe admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "cirros256", "os-flavor-access:is_public": true, "disk": 1, "swap": 0, "ram": 256, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "id": "c1"}} {{(pid=102441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:28:30.447584 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 21 09:28:30.447584 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: warnings.warn(msg) Jan 21 09:28:30.553791 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: INFO nova.api.openstack.requestlog [None req-f0617ecc-ba8a-4fad-872d-bfee81feacbe admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.189378 Jan 21 09:28:30.554575 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: [pid: 102441|app: 0|req: 2/5] 10.222.0.45 () {64 vars in 1282 bytes} [Fri Jan 21 09:28:30 2022] POST /compute/v2.1/flavors => generated 407 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 21 09:28:30.781884 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi [None req-3e7448ca-c9d5-4b02-890e-5995e97d6471 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102442) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:28:30.785250 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 21 09:28:30.785250 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: warnings.warn(msg) Jan 21 09:28:30.921704 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: INFO nova.api.openstack.requestlog [None req-3e7448ca-c9d5-4b02-890e-5995e97d6471 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.358944 Jan 21 09:28:30.922250 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: [pid: 102442|app: 0|req: 4/6] 10.222.0.45 () {64 vars in 1335 bytes} [Fri Jan 21 09:28:30 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 09:28:33.255379 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi [None req-f0617ecc-ba8a-4fad-872d-bfee81feacbe admin admin] Calling method '>' {{(pid=102441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:28:33.256514 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: INFO nova.api.openstack.requestlog [None req-f0617ecc-ba8a-4fad-872d-bfee81feacbe admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001615 Jan 21 09:28:33.256997 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: [pid: 102441|app: 0|req: 3/7] 10.222.0.45 () {54 vars in 930 bytes} [Fri Jan 21 09:28:33 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 09:28:33.373647 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi [None req-ad00eb9a-aa9c-48de-b4a4-cb4a98a27cec admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 5, "os-flavor-access:is_public": true, "id": "d1", "ram": 512, "name": "ds512M", "vcpus": 1, "rxtx_factor": 1.0}} {{(pid=102442) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:28:33.392554 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 21 09:28:33.392554 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: warnings.warn(msg) Jan 21 09:28:33.504412 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: INFO nova.api.openstack.requestlog [None req-ad00eb9a-aa9c-48de-b4a4-cb4a98a27cec admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.241234 Jan 21 09:28:33.505744 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: [pid: 102442|app: 0|req: 5/8] 10.222.0.45 () {64 vars in 1282 bytes} [Fri Jan 21 09:28:33 2022] POST /compute/v2.1/flavors => generated 404 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 21 09:28:33.518545 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi [None req-8744b439-4305-4add-8598-2fa598793549 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:28:33.520166 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 21 09:28:33.520166 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: warnings.warn(msg) Jan 21 09:28:33.616223 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: INFO nova.api.openstack.requestlog [None req-8744b439-4305-4add-8598-2fa598793549 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.102026 Jan 21 09:28:33.616732 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: [pid: 102441|app: 0|req: 4/9] 10.222.0.45 () {64 vars in 1335 bytes} [Fri Jan 21 09:28:33 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:28:36.003427 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi [None req-ad00eb9a-aa9c-48de-b4a4-cb4a98a27cec admin admin] Calling method '>' {{(pid=102442) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:28:36.004816 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: INFO nova.api.openstack.requestlog [None req-ad00eb9a-aa9c-48de-b4a4-cb4a98a27cec admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002638 Jan 21 09:28:36.005533 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: [pid: 102442|app: 0|req: 6/10] 10.222.0.45 () {54 vars in 930 bytes} [Fri Jan 21 09:28:36 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 09:28:36.066844 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi [None req-cce7faaa-3b52-4895-b956-5c285dd57ba0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "ram": 1024, "os-flavor-access:is_public": true, "id": "d2", "rxtx_factor": 1.0, "name": "ds1G", "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1}} {{(pid=102441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:28:36.142501 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: INFO nova.api.openstack.requestlog [None req-cce7faaa-3b52-4895-b956-5c285dd57ba0 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.130870 Jan 21 09:28:36.150156 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: [pid: 102441|app: 0|req: 5/11] 10.222.0.45 () {64 vars in 1282 bytes} [Fri Jan 21 09:28:36 2022] POST /compute/v2.1/flavors => generated 404 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 21 09:28:36.155395 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi [None req-a26521a8-a69c-49f4-857b-02363ba522c4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102442) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:28:36.276530 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: INFO nova.api.openstack.requestlog [None req-a26521a8-a69c-49f4-857b-02363ba522c4 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.124937 Jan 21 09:28:36.277202 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: [pid: 102442|app: 0|req: 7/12] 10.222.0.45 () {64 vars in 1335 bytes} [Fri Jan 21 09:28:36 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:28:38.601452 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi [None req-cce7faaa-3b52-4895-b956-5c285dd57ba0 admin admin] Calling method '>' {{(pid=102441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:28:38.602685 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: INFO nova.api.openstack.requestlog [None req-cce7faaa-3b52-4895-b956-5c285dd57ba0 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001836 Jan 21 09:28:38.603200 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: [pid: 102441|app: 0|req: 6/13] 10.222.0.45 () {54 vars in 930 bytes} [Fri Jan 21 09:28:38 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 09:28:38.668944 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi [None req-794225ad-6156-4eca-bcb0-44e8c78148d6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds2G", "rxtx_factor": 1.0, "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048, "id": "d3", "disk": 10, "os-flavor-access:is_public": true, "swap": 0}} {{(pid=102442) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:28:38.751231 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: INFO nova.api.openstack.requestlog [None req-794225ad-6156-4eca-bcb0-44e8c78148d6 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.140160 Jan 21 09:28:38.752025 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: [pid: 102442|app: 0|req: 8/14] 10.222.0.45 () {64 vars in 1282 bytes} [Fri Jan 21 09:28:38 2022] POST /compute/v2.1/flavors => generated 404 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 21 09:28:38.764976 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi [None req-a26f25ae-357e-4939-9d11-9ad79fa7cfa7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:28:38.866293 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: INFO nova.api.openstack.requestlog [None req-a26f25ae-357e-4939-9d11-9ad79fa7cfa7 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.104862 Jan 21 09:28:38.867126 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: [pid: 102441|app: 0|req: 7/15] 10.222.0.45 () {64 vars in 1335 bytes} [Fri Jan 21 09:28:38 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:28:41.249352 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi [None req-794225ad-6156-4eca-bcb0-44e8c78148d6 admin admin] Calling method '>' {{(pid=102442) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:28:41.251666 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: INFO nova.api.openstack.requestlog [None req-794225ad-6156-4eca-bcb0-44e8c78148d6 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002371 Jan 21 09:28:41.252591 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: [pid: 102442|app: 0|req: 9/16] 10.222.0.45 () {54 vars in 930 bytes} [Fri Jan 21 09:28:41 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 09:28:41.314262 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi [None req-0313a047-0d25-43b1-a833-936ee87f336f admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "vcpus": 4, "id": "d4", "name": "ds4G", "rxtx_factor": 1.0, "ram": 4096, "swap": 0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=102441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:28:41.400182 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: INFO nova.api.openstack.requestlog [None req-0313a047-0d25-43b1-a833-936ee87f336f admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.140786 Jan 21 09:28:41.400940 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: [pid: 102441|app: 0|req: 8/17] 10.222.0.45 () {64 vars in 1282 bytes} [Fri Jan 21 09:28:41 2022] POST /compute/v2.1/flavors => generated 404 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 21 09:28:41.413810 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi [None req-b0b5bcae-58cc-4123-80b2-d9dff1d4a2ba admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102442) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:28:41.508454 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: INFO nova.api.openstack.requestlog [None req-b0b5bcae-58cc-4123-80b2-d9dff1d4a2ba admin admin] 10.222.0.45 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.098336 Jan 21 09:28:41.509039 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: [pid: 102442|app: 0|req: 10/18] 10.222.0.45 () {64 vars in 1335 bytes} [Fri Jan 21 09:28:41 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:28:43.878773 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi [None req-0313a047-0d25-43b1-a833-936ee87f336f admin admin] Calling method '>' {{(pid=102441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:28:43.880414 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: INFO nova.api.openstack.requestlog [None req-0313a047-0d25-43b1-a833-936ee87f336f admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002095 Jan 21 09:28:43.880866 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: [pid: 102441|app: 0|req: 9/19] 10.222.0.45 () {54 vars in 930 bytes} [Fri Jan 21 09:28:43 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 09:28:43.945020 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi [None req-3cb18275-fb06-4531-8d7c-6c2df50607ea admin admin] Calling method '>' {{(pid=102442) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:28:43.969267 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: INFO nova.api.openstack.requestlog [None req-3cb18275-fb06-4531-8d7c-6c2df50607ea admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.082225 Jan 21 09:28:43.969929 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: [pid: 102442|app: 0|req: 11/20] 10.222.0.45 () {60 vars in 1291 bytes} [Fri Jan 21 09:28:43 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 21 09:28:46.293639 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi [None req-0313a047-0d25-43b1-a833-936ee87f336f admin admin] Calling method '>' {{(pid=102441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:28:46.296602 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: INFO nova.api.openstack.requestlog [None req-0313a047-0d25-43b1-a833-936ee87f336f admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.004030 Jan 21 09:28:46.297725 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: [pid: 102441|app: 0|req: 10/21] 10.222.0.45 () {54 vars in 930 bytes} [Fri Jan 21 09:28:46 2022] GET /compute/v2.1 => generated 388 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 09:28:46.360269 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi [None req-90e31bd7-935c-4e72-a6d6-8c9a5768e2fa admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.tiny", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "id": "1", "disk": 1, "rxtx_factor": 1.0, "vcpus": 1, "ram": 512, "os-flavor-access:is_public": true}} {{(pid=102442) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:28:46.485765 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: INFO nova.api.openstack.requestlog [None req-90e31bd7-935c-4e72-a6d6-8c9a5768e2fa admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.179100 Jan 21 09:28:46.486251 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: [pid: 102442|app: 0|req: 12/22] 10.222.0.45 () {64 vars in 1282 bytes} [Fri Jan 21 09:28:46 2022] POST /compute/v2.1/flavors => generated 402 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 21 09:28:46.500519 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi [None req-a527fb88-207c-4e80-9618-018a19600552 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:28:46.612330 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: INFO nova.api.openstack.requestlog [None req-a527fb88-207c-4e80-9618-018a19600552 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.116691 Jan 21 09:28:46.613376 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: [pid: 102441|app: 0|req: 11/23] 10.222.0.45 () {64 vars in 1332 bytes} [Fri Jan 21 09:28:46 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:28:49.029902 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi [None req-90e31bd7-935c-4e72-a6d6-8c9a5768e2fa admin admin] Calling method '>' {{(pid=102442) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:28:49.031247 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: INFO nova.api.openstack.requestlog [None req-90e31bd7-935c-4e72-a6d6-8c9a5768e2fa admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001992 Jan 21 09:28:49.031794 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: [pid: 102442|app: 0|req: 13/24] 10.222.0.45 () {54 vars in 930 bytes} [Fri Jan 21 09:28:49 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 09:28:49.098475 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi [None req-66807f4e-5480-4362-bb57-48ad8ee099de admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "ram": 2048, "swap": 0, "rxtx_factor": 1.0, "id": "2", "disk": 20, "name": "m1.small", "os-flavor-access:is_public": true}} {{(pid=102441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:28:49.190060 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: INFO nova.api.openstack.requestlog [None req-66807f4e-5480-4362-bb57-48ad8ee099de admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.151156 Jan 21 09:28:49.190985 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: [pid: 102441|app: 0|req: 12/25] 10.222.0.45 () {64 vars in 1282 bytes} [Fri Jan 21 09:28:49 2022] POST /compute/v2.1/flavors => generated 405 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 21 09:28:49.207492 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi [None req-3f0f4302-0dda-4f5f-a5ab-8761592538a0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102442) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:28:49.420332 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: INFO nova.api.openstack.requestlog [None req-3f0f4302-0dda-4f5f-a5ab-8761592538a0 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.220541 Jan 21 09:28:49.420860 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: [pid: 102442|app: 0|req: 14/26] 10.222.0.45 () {64 vars in 1332 bytes} [Fri Jan 21 09:28:49 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:28:51.719186 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi [None req-66807f4e-5480-4362-bb57-48ad8ee099de admin admin] Calling method '>' {{(pid=102441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:28:51.720335 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: INFO nova.api.openstack.requestlog [None req-66807f4e-5480-4362-bb57-48ad8ee099de admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001653 Jan 21 09:28:51.720748 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: [pid: 102441|app: 0|req: 13/27] 10.222.0.45 () {54 vars in 930 bytes} [Fri Jan 21 09:28:51 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 09:28:51.780639 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi [None req-89675b13-e8d0-4f46-91cd-dd2f70000088 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.medium", "vcpus": 2, "rxtx_factor": 1.0, "ram": 4096, "os-flavor-access:is_public": true, "disk": 40, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "3"}} {{(pid=102442) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:28:51.868274 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: INFO nova.api.openstack.requestlog [None req-89675b13-e8d0-4f46-91cd-dd2f70000088 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.140741 Jan 21 09:28:51.868834 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: [pid: 102442|app: 0|req: 15/28] 10.222.0.45 () {64 vars in 1282 bytes} [Fri Jan 21 09:28:51 2022] POST /compute/v2.1/flavors => generated 406 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 21 09:28:51.881495 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi [None req-2b2c6d85-2f09-4c22-bdd9-5e7373987b11 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:28:51.968702 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: INFO nova.api.openstack.requestlog [None req-2b2c6d85-2f09-4c22-bdd9-5e7373987b11 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.091549 Jan 21 09:28:51.969450 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: [pid: 102441|app: 0|req: 14/29] 10.222.0.45 () {64 vars in 1332 bytes} [Fri Jan 21 09:28:51 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:28:54.378322 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi [None req-89675b13-e8d0-4f46-91cd-dd2f70000088 admin admin] Calling method '>' {{(pid=102442) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:28:54.379994 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: INFO nova.api.openstack.requestlog [None req-89675b13-e8d0-4f46-91cd-dd2f70000088 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002494 Jan 21 09:28:54.380398 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: [pid: 102442|app: 0|req: 16/30] 10.222.0.45 () {54 vars in 930 bytes} [Fri Jan 21 09:28:54 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 09:28:54.446935 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi [None req-6ef7cb0f-af10-4ceb-99bb-c60d134b4258 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "4", "disk": 80, "swap": 0, "rxtx_factor": 1.0, "ram": 8192, "os-flavor-access:is_public": true, "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.large"}} {{(pid=102441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:28:54.530780 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: INFO nova.api.openstack.requestlog [None req-6ef7cb0f-af10-4ceb-99bb-c60d134b4258 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.144044 Jan 21 09:28:54.532468 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: [pid: 102441|app: 0|req: 15/31] 10.222.0.45 () {64 vars in 1282 bytes} [Fri Jan 21 09:28:54 2022] POST /compute/v2.1/flavors => generated 405 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 21 09:28:54.544331 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi [None req-9eaef587-0342-4a42-bf8a-557ff1ff1570 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102442) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:28:54.649816 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: INFO nova.api.openstack.requestlog [None req-9eaef587-0342-4a42-bf8a-557ff1ff1570 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.109043 Jan 21 09:28:54.650397 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: [pid: 102442|app: 0|req: 17/32] 10.222.0.45 () {64 vars in 1332 bytes} [Fri Jan 21 09:28:54 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:28:57.212884 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi [None req-6ef7cb0f-af10-4ceb-99bb-c60d134b4258 admin admin] Calling method '>' {{(pid=102441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:28:57.221832 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: INFO nova.api.openstack.requestlog [None req-6ef7cb0f-af10-4ceb-99bb-c60d134b4258 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001517 Jan 21 09:28:57.221832 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: [pid: 102441|app: 0|req: 16/33] 10.222.0.45 () {54 vars in 930 bytes} [Fri Jan 21 09:28:57 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 21 09:28:57.290464 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi [None req-e4266bc8-4a42-4f42-bdc2-a73c1318aa7d admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 8, "disk": 160, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 16384, "id": "5", "swap": 0, "name": "m1.xlarge", "os-flavor-access:is_public": true}} {{(pid=102442) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:28:57.421841 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: INFO nova.api.openstack.requestlog [None req-e4266bc8-4a42-4f42-bdc2-a73c1318aa7d admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.198170 Jan 21 09:28:57.429656 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: [pid: 102442|app: 0|req: 18/34] 10.222.0.45 () {64 vars in 1282 bytes} [Fri Jan 21 09:28:57 2022] POST /compute/v2.1/flavors => generated 408 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 21 09:28:57.435181 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi [None req-d6c4e684-27fa-40c3-a5bb-de033154cf98 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:28:57.545707 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: INFO nova.api.openstack.requestlog [None req-d6c4e684-27fa-40c3-a5bb-de033154cf98 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.114429 Jan 21 09:28:57.546448 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: [pid: 102441|app: 0|req: 17/35] 10.222.0.45 () {64 vars in 1332 bytes} [Fri Jan 21 09:28:57 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:29:21.821811 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi [None req-e4266bc8-4a42-4f42-bdc2-a73c1318aa7d admin admin] Calling method '>' {{(pid=102442) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:29:21.822824 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: INFO nova.api.openstack.requestlog [None req-e4266bc8-4a42-4f42-bdc2-a73c1318aa7d admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001494 Jan 21 09:29:21.823226 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: [pid: 102442|app: 0|req: 19/36] 10.222.0.45 () {54 vars in 930 bytes} [Fri Jan 21 09:29:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 21 09:29:21.890336 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi [None req-f2c38350-e8ec-430e-9583-816566d203fc admin admin] Calling method '>' {{(pid=102441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:29:21.904789 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: INFO nova.api.openstack.requestlog [None req-f2c38350-e8ec-430e-9583-816566d203fc admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.069534 Jan 21 09:29:21.905367 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: [pid: 102441|app: 0|req: 18/37] 10.222.0.45 () {60 vars in 1291 bytes} [Fri Jan 21 09:29:21 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 21 09:29:23.309452 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi [None req-e4266bc8-4a42-4f42-bdc2-a73c1318aa7d admin admin] Calling method '>' {{(pid=102442) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:29:23.310491 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: INFO nova.api.openstack.requestlog [None req-e4266bc8-4a42-4f42-bdc2-a73c1318aa7d admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001436 Jan 21 09:29:23.310915 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: [pid: 102442|app: 0|req: 20/38] 10.222.0.45 () {56 vars in 1074 bytes} [Fri Jan 21 09:29:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 09:29:23.514173 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi [None req-44aebfdb-b551-4b04-875d-4bdb55e6b78a admin admin] Calling method '>' {{(pid=102441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:29:23.520302 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: INFO nova.api.openstack.wsgi [None req-44aebfdb-b551-4b04-875d-4bdb55e6b78a admin admin] HTTP exception thrown: Flavor 42 could not be found. Jan 21 09:29:23.520904 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi [None req-44aebfdb-b551-4b04-875d-4bdb55e6b78a admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=102441) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 21 09:29:23.521727 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: INFO nova.api.openstack.requestlog [None req-44aebfdb-b551-4b04-875d-4bdb55e6b78a admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.060667 Jan 21 09:29:23.522258 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: [pid: 102441|app: 0|req: 19/39] 10.222.0.45 () {60 vars in 1190 bytes} [Fri Jan 21 09:29:23 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jan 21 09:29:23.531696 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi [None req-fb68c47e-e79b-4f15-9fe9-e433aa190f58 admin admin] Calling method '>' {{(pid=102442) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:29:23.553008 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: INFO nova.api.openstack.requestlog [None req-fb68c47e-e79b-4f15-9fe9-e433aa190f58 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024980 Jan 21 09:29:23.553601 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: [pid: 102442|app: 0|req: 21/40] 10.222.0.45 () {60 vars in 1210 bytes} [Fri Jan 21 09:29:23 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 21 09:29:23.563328 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi [None req-b908341c-7176-4e89-8fac-3ee328129e94 admin admin] Calling method '>' {{(pid=102441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:29:23.584738 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: INFO nova.api.openstack.requestlog [None req-b908341c-7176-4e89-8fac-3ee328129e94 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024958 Jan 21 09:29:23.585292 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: [pid: 102441|app: 0|req: 20/41] 10.222.0.45 () {60 vars in 1210 bytes} [Fri Jan 21 09:29:23 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 21 09:29:23.594673 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi [None req-dbe68e6f-8355-4c55-ba1e-eb01553ddd5f admin admin] Calling method '>' {{(pid=102442) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:29:23.600790 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: INFO nova.api.openstack.wsgi [None req-dbe68e6f-8355-4c55-ba1e-eb01553ddd5f admin admin] HTTP exception thrown: Flavor 42 could not be found. Jan 21 09:29:23.601403 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi [None req-dbe68e6f-8355-4c55-ba1e-eb01553ddd5f admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=102442) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 21 09:29:23.602215 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: INFO nova.api.openstack.requestlog [None req-dbe68e6f-8355-4c55-ba1e-eb01553ddd5f admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.011178 Jan 21 09:29:23.602730 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: [pid: 102442|app: 0|req: 22/42] 10.222.0.45 () {60 vars in 1190 bytes} [Fri Jan 21 09:29:23 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jan 21 09:29:24.946784 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi [None req-b908341c-7176-4e89-8fac-3ee328129e94 admin admin] Calling method '>' {{(pid=102441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:29:24.947799 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: INFO nova.api.openstack.requestlog [None req-b908341c-7176-4e89-8fac-3ee328129e94 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001448 Jan 21 09:29:24.948192 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: [pid: 102441|app: 0|req: 21/43] 10.222.0.45 () {56 vars in 1074 bytes} [Fri Jan 21 09:29:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 09:29:25.148294 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi [None req-c4f7de29-6709-4f22-8aef-d9ef882a2e65 admin admin] Calling method '>' {{(pid=102442) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:29:25.154055 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: INFO nova.api.openstack.wsgi [None req-c4f7de29-6709-4f22-8aef-d9ef882a2e65 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jan 21 09:29:25.154562 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi [None req-c4f7de29-6709-4f22-8aef-d9ef882a2e65 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=102442) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 21 09:29:25.155355 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: INFO nova.api.openstack.requestlog [None req-c4f7de29-6709-4f22-8aef-d9ef882a2e65 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.062729 Jan 21 09:29:25.155871 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: [pid: 102442|app: 0|req: 23/44] 10.222.0.45 () {60 vars in 1190 bytes} [Fri Jan 21 09:29:25 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jan 21 09:29:25.165627 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi [None req-b17c6f24-6659-47a4-920d-f8250acdf516 admin admin] Calling method '>' {{(pid=102441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:29:25.179935 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: INFO nova.api.openstack.requestlog [None req-b17c6f24-6659-47a4-920d-f8250acdf516 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017793 Jan 21 09:29:25.180491 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: [pid: 102441|app: 0|req: 22/45] 10.222.0.45 () {60 vars in 1210 bytes} [Fri Jan 21 09:29:25 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 21 09:29:25.191299 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi [None req-bee1e5a1-4f7a-47b3-9356-63e751cb14b2 admin admin] Calling method '>' {{(pid=102442) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:29:25.205035 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: INFO nova.api.openstack.requestlog [None req-bee1e5a1-4f7a-47b3-9356-63e751cb14b2 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018373 Jan 21 09:29:25.206712 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: [pid: 102442|app: 0|req: 24/46] 10.222.0.45 () {60 vars in 1210 bytes} [Fri Jan 21 09:29:25 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 21 09:29:25.215887 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi [None req-9107879c-b130-483e-8d73-843b3f394853 admin admin] Calling method '>' {{(pid=102441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:29:25.221645 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: INFO nova.api.openstack.wsgi [None req-9107879c-b130-483e-8d73-843b3f394853 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jan 21 09:29:25.222210 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi [None req-9107879c-b130-483e-8d73-843b3f394853 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=102441) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 21 09:29:25.222993 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: INFO nova.api.openstack.requestlog [None req-9107879c-b130-483e-8d73-843b3f394853 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.010689 Jan 21 09:29:25.223492 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: [pid: 102441|app: 0|req: 23/47] 10.222.0.45 () {60 vars in 1190 bytes} [Fri Jan 21 09:29:25 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jan 21 09:29:26.514943 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi [None req-bee1e5a1-4f7a-47b3-9356-63e751cb14b2 admin admin] Calling method '>' {{(pid=102442) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:29:26.515941 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: INFO nova.api.openstack.requestlog [None req-bee1e5a1-4f7a-47b3-9356-63e751cb14b2 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001459 Jan 21 09:29:26.516334 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: [pid: 102442|app: 0|req: 25/48] 10.222.0.45 () {56 vars in 1074 bytes} [Fri Jan 21 09:29:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 09:29:26.731267 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi [None req-5319bf35-0b68-4e5b-bc23-ee52ee27cd19 admin admin] Calling method '>' {{(pid=102441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:29:26.737413 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: INFO nova.api.openstack.wsgi [None req-5319bf35-0b68-4e5b-bc23-ee52ee27cd19 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jan 21 09:29:26.737993 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi [None req-5319bf35-0b68-4e5b-bc23-ee52ee27cd19 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=102441) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 21 09:29:26.738798 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: INFO nova.api.openstack.requestlog [None req-5319bf35-0b68-4e5b-bc23-ee52ee27cd19 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.068051 Jan 21 09:29:26.739338 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: [pid: 102441|app: 0|req: 24/49] 10.222.0.45 () {60 vars in 1193 bytes} [Fri Jan 21 09:29:26 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jan 21 09:29:26.749219 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi [None req-197ea5b2-48fe-4250-ba25-e5b01f94113b admin admin] Calling method '>' {{(pid=102442) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:29:26.763105 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: INFO nova.api.openstack.requestlog [None req-197ea5b2-48fe-4250-ba25-e5b01f94113b admin admin] 10.222.0.45 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017666 Jan 21 09:29:26.763643 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: [pid: 102442|app: 0|req: 26/50] 10.222.0.45 () {60 vars in 1210 bytes} [Fri Jan 21 09:29:26 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 21 09:29:26.774153 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi [None req-91e8fd9a-c5a2-45eb-b127-30f20ddd017f admin admin] Calling method '>' {{(pid=102441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:29:26.787850 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: INFO nova.api.openstack.requestlog [None req-91e8fd9a-c5a2-45eb-b127-30f20ddd017f admin admin] 10.222.0.45 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017645 Jan 21 09:29:26.788389 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: [pid: 102441|app: 0|req: 25/51] 10.222.0.45 () {60 vars in 1210 bytes} [Fri Jan 21 09:29:26 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 21 09:29:26.797565 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi [None req-1ddc9e91-7874-4c77-8163-61a1dbfaf3b2 admin admin] Calling method '>' {{(pid=102442) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:29:26.803954 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: INFO nova.api.openstack.wsgi [None req-1ddc9e91-7874-4c77-8163-61a1dbfaf3b2 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jan 21 09:29:26.804522 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi [None req-1ddc9e91-7874-4c77-8163-61a1dbfaf3b2 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=102442) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 21 09:29:26.805364 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: INFO nova.api.openstack.requestlog [None req-1ddc9e91-7874-4c77-8163-61a1dbfaf3b2 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011281 Jan 21 09:29:26.805873 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: [pid: 102442|app: 0|req: 27/52] 10.222.0.45 () {60 vars in 1193 bytes} [Fri Jan 21 09:29:26 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jan 21 09:29:28.108475 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi [None req-91e8fd9a-c5a2-45eb-b127-30f20ddd017f admin admin] Calling method '>' {{(pid=102441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:29:28.109591 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: INFO nova.api.openstack.requestlog [None req-91e8fd9a-c5a2-45eb-b127-30f20ddd017f admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001432 Jan 21 09:29:28.109988 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: [pid: 102441|app: 0|req: 26/53] 10.222.0.45 () {56 vars in 1074 bytes} [Fri Jan 21 09:29:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 09:29:28.303956 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi [None req-8ba0fb0f-a7c9-41e9-b031-ab579644666a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102442) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:29:28.380977 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: INFO nova.api.openstack.requestlog [None req-8ba0fb0f-a7c9-41e9-b031-ab579644666a admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.128888 Jan 21 09:29:28.381458 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: [pid: 102442|app: 0|req: 28/54] 10.222.0.45 () {64 vars in 1235 bytes} [Fri Jan 21 09:29:28 2022] POST /compute/v2.1/flavors => generated 404 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 21 09:29:29.666189 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi [None req-91e8fd9a-c5a2-45eb-b127-30f20ddd017f admin admin] Calling method '>' {{(pid=102441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:29:29.667192 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: INFO nova.api.openstack.requestlog [None req-91e8fd9a-c5a2-45eb-b127-30f20ddd017f admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001414 Jan 21 09:29:29.667581 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: [pid: 102441|app: 0|req: 27/55] 10.222.0.45 () {56 vars in 1074 bytes} [Fri Jan 21 09:29:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 09:29:29.871334 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi [None req-66b70d7f-436d-4c16-beaf-78293a9826c2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102442) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:29:30.026695 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: INFO nova.api.openstack.requestlog [None req-66b70d7f-436d-4c16-beaf-78293a9826c2 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.206293 Jan 21 09:29:30.027257 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: [pid: 102442|app: 0|req: 29/56] 10.222.0.45 () {64 vars in 1235 bytes} [Fri Jan 21 09:29:29 2022] POST /compute/v2.1/flavors => generated 405 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 21 09:29:31.388598 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi [None req-91e8fd9a-c5a2-45eb-b127-30f20ddd017f admin admin] Calling method '>' {{(pid=102441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:29:31.389475 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: INFO nova.api.openstack.requestlog [None req-91e8fd9a-c5a2-45eb-b127-30f20ddd017f admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001423 Jan 21 09:29:31.389878 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: [pid: 102441|app: 0|req: 28/57] 10.222.0.45 () {56 vars in 1074 bytes} [Fri Jan 21 09:29:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 09:29:31.590971 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi [None req-724f6c78-8b70-4a5c-a9b3-ac7fec2af235 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102442) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:29:31.662219 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: INFO nova.api.openstack.requestlog [None req-724f6c78-8b70-4a5c-a9b3-ac7fec2af235 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.129143 Jan 21 09:29:31.662689 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: [pid: 102442|app: 0|req: 30/58] 10.222.0.45 () {64 vars in 1235 bytes} [Fri Jan 21 09:29:31 2022] POST /compute/v2.1/flavors => generated 407 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 21 09:29:32.969754 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi [None req-91e8fd9a-c5a2-45eb-b127-30f20ddd017f admin admin] Calling method '>' {{(pid=102441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:29:32.971549 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: INFO nova.api.openstack.requestlog [None req-91e8fd9a-c5a2-45eb-b127-30f20ddd017f admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002218 Jan 21 09:29:32.972219 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: [pid: 102441|app: 0|req: 29/59] 10.222.0.45 () {56 vars in 1074 bytes} [Fri Jan 21 09:29:32 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 09:29:33.169515 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi [None req-2755ac45-abed-4184-92a6-3e41b5d6b8bc admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102442) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:29:33.249727 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: INFO nova.api.openstack.requestlog [None req-2755ac45-abed-4184-92a6-3e41b5d6b8bc admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.133997 Jan 21 09:29:33.250339 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: [pid: 102442|app: 0|req: 31/60] 10.222.0.45 () {64 vars in 1235 bytes} [Fri Jan 21 09:29:33 2022] POST /compute/v2.1/flavors => generated 409 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 21 09:29:34.557797 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi [None req-91e8fd9a-c5a2-45eb-b127-30f20ddd017f admin admin] Calling method '>' {{(pid=102441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:29:34.558798 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: INFO nova.api.openstack.requestlog [None req-91e8fd9a-c5a2-45eb-b127-30f20ddd017f admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Jan 21 09:29:34.559194 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: [pid: 102441|app: 0|req: 30/61] 10.222.0.45 () {56 vars in 1074 bytes} [Fri Jan 21 09:29:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 09:29:34.757536 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi [None req-aafbceb6-ce5a-4ea3-99e9-5e7aa6f358a1 admin admin] Calling method '>' {{(pid=102442) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:29:34.777378 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: INFO nova.api.openstack.requestlog [None req-aafbceb6-ce5a-4ea3-99e9-5e7aa6f358a1 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.075963 Jan 21 09:29:34.777853 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: [pid: 102442|app: 0|req: 32/62] 10.222.0.45 () {60 vars in 1202 bytes} [Fri Jan 21 09:29:34 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 21 09:30:23.106241 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi [None req-91e8fd9a-c5a2-45eb-b127-30f20ddd017f admin admin] Calling method '>' {{(pid=102441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:30:23.107333 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: INFO nova.api.openstack.requestlog [None req-91e8fd9a-c5a2-45eb-b127-30f20ddd017f admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001558 Jan 21 09:30:23.107778 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: [pid: 102441|app: 0|req: 31/63] 10.222.0.45 () {54 vars in 930 bytes} [Fri Jan 21 09:30:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 09:30:23.167161 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi [None req-9d2b81d2-b40a-4ee5-a2c3-e54725ea4d22 admin admin] Calling method '>' {{(pid=102442) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:30:23.188638 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: INFO nova.api.openstack.requestlog [None req-9d2b81d2-b40a-4ee5-a2c3-e54725ea4d22 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.073175 Jan 21 09:30:23.189215 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: [pid: 102442|app: 0|req: 33/64] 10.222.0.45 () {60 vars in 1291 bytes} [Fri Jan 21 09:30:23 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 21 09:30:23.212694 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi [None req-812dcb0c-e1d3-4733-bb50-05671c9ebd0e admin admin] Calling method '>' {{(pid=102441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:30:23.221808 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: INFO nova.api.openstack.requestlog [None req-812dcb0c-e1d3-4733-bb50-05671c9ebd0e admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012739 Jan 21 09:30:23.222358 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: [pid: 102441|app: 0|req: 32/65] 10.222.0.45 () {60 vars in 1282 bytes} [Fri Jan 21 09:30:23 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:30:23.233815 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi [None req-1a142a55-99cf-4c48-9c6a-6347585c747a admin admin] Calling method '>' {{(pid=102442) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:30:23.241870 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: INFO nova.api.openstack.requestlog [None req-1a142a55-99cf-4c48-9c6a-6347585c747a admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011632 Jan 21 09:30:23.242383 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: [pid: 102442|app: 0|req: 34/66] 10.222.0.45 () {60 vars in 1285 bytes} [Fri Jan 21 09:30:23 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:30:23.254399 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi [None req-559e5d46-a8cc-457e-a23f-f06dc75b3143 admin admin] Calling method '>' {{(pid=102441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:30:23.263572 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: INFO nova.api.openstack.requestlog [None req-559e5d46-a8cc-457e-a23f-f06dc75b3143 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013283 Jan 21 09:30:23.264103 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: [pid: 102441|app: 0|req: 33/67] 10.222.0.45 () {60 vars in 1285 bytes} [Fri Jan 21 09:30:23 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 09:30:23.275928 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi [None req-6f424d2b-8991-4fd1-bbe9-ff10cd6fe57e admin admin] Calling method '>' {{(pid=102442) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:30:23.284919 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: INFO nova.api.openstack.requestlog [None req-6f424d2b-8991-4fd1-bbe9-ff10cd6fe57e admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012518 Jan 21 09:30:23.285547 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: [pid: 102442|app: 0|req: 35/68] 10.222.0.45 () {60 vars in 1282 bytes} [Fri Jan 21 09:30:23 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:32:02.691896 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi [None req-30d7ee8b-9c3c-4692-904d-d11eafca211f tempest-verify_tempest_config-1982414067 tempest-verify_tempest_config-1982414067-project] Calling method '>' {{(pid=102441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:32:02.694506 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: INFO nova.api.openstack.requestlog [None req-30d7ee8b-9c3c-4692-904d-d11eafca211f tempest-verify_tempest_config-1982414067 tempest-verify_tempest_config-1982414067-project] 10.222.0.45 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.120850 Jan 21 09:32:02.695040 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: [pid: 102441|app: 0|req: 34/69] 10.222.0.45 () {58 vars in 1133 bytes} [Fri Jan 21 09:32:02 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 21 09:33:42.739060 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi [None req-6f424d2b-8991-4fd1-bbe9-ff10cd6fe57e admin admin] Calling method '>' {{(pid=102442) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:33:42.740417 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: INFO nova.api.openstack.requestlog [None req-6f424d2b-8991-4fd1-bbe9-ff10cd6fe57e admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001541 Jan 21 09:33:42.740839 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: [pid: 102442|app: 0|req: 36/70] 10.222.0.45 () {56 vars in 1074 bytes} [Fri Jan 21 09:33:42 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 09:33:43.030207 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi [None req-8d5a3367-1a88-411e-a72b-6b30556f8cd4 admin admin] Calling method '>' {{(pid=102441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:33:43.031480 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 21 09:33:43.031480 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: warnings.warn(msg) Jan 21 09:33:43.033345 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG oslo_concurrency.lockutils [None req-8d5a3367-1a88-411e-a72b-6b30556f8cd4 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:33:43.033795 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG oslo_concurrency.lockutils [None req-8d5a3367-1a88-411e-a72b-6b30556f8cd4 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:33:43.034607 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG oslo_concurrency.lockutils [None req-8d5a3367-1a88-411e-a72b-6b30556f8cd4 admin admin] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:33:43.035034 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG oslo_concurrency.lockutils [None req-8d5a3367-1a88-411e-a72b-6b30556f8cd4 admin admin] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:33:43.070271 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: INFO nova.api.openstack.requestlog [None req-8d5a3367-1a88-411e-a72b-6b30556f8cd4 admin admin] 10.222.0.45 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.178395 Jan 21 09:33:43.070865 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: [pid: 102441|app: 0|req: 35/71] 10.222.0.45 () {60 vars in 1193 bytes} [Fri Jan 21 09:33:42 2022] GET /compute/v2.1/os-services => generated 794 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 21 09:33:44.425902 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi [None req-6f424d2b-8991-4fd1-bbe9-ff10cd6fe57e admin admin] Calling method '>' {{(pid=102442) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:33:44.427462 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: INFO nova.api.openstack.requestlog [None req-6f424d2b-8991-4fd1-bbe9-ff10cd6fe57e admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001762 Jan 21 09:33:44.428272 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: [pid: 102442|app: 0|req: 37/72] 10.222.0.45 () {56 vars in 1074 bytes} [Fri Jan 21 09:33:44 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 09:33:44.665361 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi [None req-780f34cf-6b10-4109-992a-ccaaa2c6a236 admin admin] Calling method '>' {{(pid=102441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:33:44.666597 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 21 09:33:44.666597 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: warnings.warn(msg) Jan 21 09:33:44.669331 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG oslo_concurrency.lockutils [None req-780f34cf-6b10-4109-992a-ccaaa2c6a236 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:33:44.669776 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG oslo_concurrency.lockutils [None req-780f34cf-6b10-4109-992a-ccaaa2c6a236 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:33:44.670576 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG oslo_concurrency.lockutils [None req-780f34cf-6b10-4109-992a-ccaaa2c6a236 admin admin] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:33:44.671001 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG oslo_concurrency.lockutils [None req-780f34cf-6b10-4109-992a-ccaaa2c6a236 admin admin] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:33:44.691773 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: INFO nova.api.openstack.requestlog [None req-780f34cf-6b10-4109-992a-ccaaa2c6a236 admin admin] 10.222.0.45 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.084450 Jan 21 09:33:44.692436 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: [pid: 102441|app: 0|req: 36/73] 10.222.0.45 () {60 vars in 1193 bytes} [Fri Jan 21 09:33:44 2022] GET /compute/v2.1/os-services => generated 794 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 21 09:33:56.478765 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi [None req-6f424d2b-8991-4fd1-bbe9-ff10cd6fe57e admin admin] Calling method '>' {{(pid=102442) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:33:56.479758 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: INFO nova.api.openstack.requestlog [None req-6f424d2b-8991-4fd1-bbe9-ff10cd6fe57e admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001423 Jan 21 09:33:56.480188 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: [pid: 102442|app: 0|req: 38/74] 10.222.0.45 () {56 vars in 1074 bytes} [Fri Jan 21 09:33:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 09:33:56.693812 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi [None req-1cd0b8b3-20ed-467e-8e5e-1bc9fac7a600 admin admin] Calling method '>' {{(pid=102441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:33:56.695357 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 21 09:33:56.695357 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: warnings.warn(msg) Jan 21 09:33:56.697064 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG oslo_concurrency.lockutils [None req-1cd0b8b3-20ed-467e-8e5e-1bc9fac7a600 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:33:56.698521 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG oslo_concurrency.lockutils [None req-1cd0b8b3-20ed-467e-8e5e-1bc9fac7a600 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:33:56.698976 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG oslo_concurrency.lockutils [None req-1cd0b8b3-20ed-467e-8e5e-1bc9fac7a600 admin admin] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=102441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:33:56.699426 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG oslo_concurrency.lockutils [None req-1cd0b8b3-20ed-467e-8e5e-1bc9fac7a600 admin admin] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:33:56.724546 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: INFO nova.api.openstack.requestlog [None req-1cd0b8b3-20ed-467e-8e5e-1bc9fac7a600 admin admin] 10.222.0.45 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.90 time: 0.086375 Jan 21 09:33:56.725131 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: [pid: 102441|app: 0|req: 37/75] 10.222.0.45 () {60 vars in 1193 bytes} [Fri Jan 21 09:33:56 2022] GET /compute/v2.1/os-services => generated 1038 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 21 09:33:58.123544 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: DEBUG nova.api.openstack.wsgi [None req-6f424d2b-8991-4fd1-bbe9-ff10cd6fe57e admin admin] Calling method '>' {{(pid=102442) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:33:58.125237 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: INFO nova.api.openstack.requestlog [None req-6f424d2b-8991-4fd1-bbe9-ff10cd6fe57e admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002441 Jan 21 09:33:58.125916 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: [pid: 102442|app: 0|req: 39/76] 10.222.0.45 () {56 vars in 1074 bytes} [Fri Jan 21 09:33:58 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 21 09:33:58.368771 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG nova.api.openstack.wsgi [None req-cd8971ba-d4f3-49cd-a0a6-93492f99de53 admin admin] Calling method '>' {{(pid=102441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:33:58.370602 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 21 09:33:58.370602 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: warnings.warn(msg) Jan 21 09:33:58.372216 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG oslo_concurrency.lockutils [None req-cd8971ba-d4f3-49cd-a0a6-93492f99de53 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:33:58.380519 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG oslo_concurrency.lockutils [None req-cd8971ba-d4f3-49cd-a0a6-93492f99de53 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:33:58.380519 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG oslo_concurrency.lockutils [None req-cd8971ba-d4f3-49cd-a0a6-93492f99de53 admin admin] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:33:58.380519 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: DEBUG oslo_concurrency.lockutils [None req-cd8971ba-d4f3-49cd-a0a6-93492f99de53 admin admin] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:33:58.400887 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: INFO nova.api.openstack.requestlog [None req-cd8971ba-d4f3-49cd-a0a6-93492f99de53 admin admin] 10.222.0.45 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.90 time: 0.100017 Jan 21 09:33:58.403149 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: [pid: 102441|app: 0|req: 38/77] 10.222.0.45 () {60 vars in 1193 bytes} [Fri Jan 21 09:33:58 2022] GET /compute/v2.1/os-services => generated 1038 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 21 09:34:58.939321 dv-cinder-804035-25-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jan 21 09:34:58.939892 dv-cinder-804035-25-iscsi devstack@n-api.service[102440]: Fri Jan 21 09:34:58 2022 - graceful shutdown triggered... Jan 21 09:34:58.940374 dv-cinder-804035-25-iscsi devstack@n-api.service[102441]: Gracefully killing worker 1 (pid: 102441)... Jan 21 09:34:58.940752 dv-cinder-804035-25-iscsi devstack@n-api.service[102442]: Gracefully killing worker 2 (pid: 102442)... Jan 21 09:34:59.941199 dv-cinder-804035-25-iscsi devstack@n-api.service[102440]: worker 1 buried after 1 seconds Jan 21 09:34:59.941199 dv-cinder-804035-25-iscsi devstack@n-api.service[102440]: worker 2 buried after 1 seconds Jan 21 09:34:59.941199 dv-cinder-804035-25-iscsi devstack@n-api.service[102440]: goodbye to uWSGI. Jan 21 09:34:59.942891 dv-cinder-804035-25-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jan 21 09:34:59.943483 dv-cinder-804035-25-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jan 21 09:34:59.947077 dv-cinder-804035-25-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jan 21 09:34:59.965758 dv-cinder-804035-25-iscsi devstack@n-api.service[123373]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jan 21 09:34:59.967926 dv-cinder-804035-25-iscsi devstack@n-api.service[123373]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Jan 21 09:34:59 2022] *** Jan 21 09:34:59.967926 dv-cinder-804035-25-iscsi devstack@n-api.service[123373]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jan 21 09:34:59.967926 dv-cinder-804035-25-iscsi devstack@n-api.service[123373]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jan 21 09:34:59.967926 dv-cinder-804035-25-iscsi devstack@n-api.service[123373]: nodename: dv-cinder-804035-25-iscsi Jan 21 09:34:59.967926 dv-cinder-804035-25-iscsi devstack@n-api.service[123373]: machine: x86_64 Jan 21 09:34:59.967926 dv-cinder-804035-25-iscsi devstack@n-api.service[123373]: clock source: unix Jan 21 09:34:59.967926 dv-cinder-804035-25-iscsi devstack@n-api.service[123373]: pcre jit disabled Jan 21 09:34:59.967926 dv-cinder-804035-25-iscsi devstack@n-api.service[123373]: detected number of CPU cores: 4 Jan 21 09:34:59.967926 dv-cinder-804035-25-iscsi devstack@n-api.service[123373]: current working directory: / Jan 21 09:34:59.967926 dv-cinder-804035-25-iscsi devstack@n-api.service[123373]: detected binary path: /usr/bin/uwsgi-core Jan 21 09:34:59.967926 dv-cinder-804035-25-iscsi devstack@n-api.service[123373]: your processes number limit is 47680 Jan 21 09:34:59.968715 dv-cinder-804035-25-iscsi devstack@n-api.service[123373]: your memory page size is 4096 bytes Jan 21 09:34:59.968715 dv-cinder-804035-25-iscsi devstack@n-api.service[123373]: detected max file descriptor number: 2048 Jan 21 09:34:59.968715 dv-cinder-804035-25-iscsi devstack@n-api.service[123373]: lock engine: pthread robust mutexes Jan 21 09:34:59.968715 dv-cinder-804035-25-iscsi devstack@n-api.service[123373]: thunder lock: enabled Jan 21 09:34:59.968715 dv-cinder-804035-25-iscsi devstack@n-api.service[123373]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jan 21 09:34:59.968715 dv-cinder-804035-25-iscsi devstack@n-api.service[123373]: Python version: 3.8.10 (default, Nov 26 2021, 20:14:08) [GCC 9.3.0] Jan 21 09:35:00.015661 dv-cinder-804035-25-iscsi devstack@n-api.service[123373]: Python main interpreter initialized at 0x5571b244e9c0 Jan 21 09:35:00.015661 dv-cinder-804035-25-iscsi devstack@n-api.service[123373]: python threads support enabled Jan 21 09:35:00.015661 dv-cinder-804035-25-iscsi devstack@n-api.service[123373]: your server socket listen backlog is limited to 100 connections Jan 21 09:35:00.015661 dv-cinder-804035-25-iscsi devstack@n-api.service[123373]: your mercy for graceful operations on workers is 90 seconds Jan 21 09:35:00.016143 dv-cinder-804035-25-iscsi devstack@n-api.service[123373]: mapped 403077 bytes (393 KB) for 2 cores Jan 21 09:35:00.016143 dv-cinder-804035-25-iscsi devstack@n-api.service[123373]: *** Operational MODE: preforking *** Jan 21 09:35:00.016390 dv-cinder-804035-25-iscsi devstack@n-api.service[123373]: *** uWSGI is running in multiple interpreter mode *** Jan 21 09:35:00.016390 dv-cinder-804035-25-iscsi devstack@n-api.service[123373]: spawned uWSGI master process (pid: 123373) Jan 21 09:35:00.016586 dv-cinder-804035-25-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jan 21 09:35:00.018690 dv-cinder-804035-25-iscsi devstack@n-api.service[123373]: spawned uWSGI worker 1 (pid: 123386, cores: 1) Jan 21 09:35:00.018690 dv-cinder-804035-25-iscsi devstack@n-api.service[123373]: spawned uWSGI worker 2 (pid: 123387, cores: 1) Jan 21 09:35:00.018690 dv-cinder-804035-25-iscsi devstack@n-api.service[123373]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jan 21 09:35:02.010095 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 21 09:35:02.010095 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: from cryptography.utils import int_from_bytes Jan 21 09:35:02.010808 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 21 09:35:02.010808 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: from cryptography.utils import int_from_bytes Jan 21 09:35:02.014546 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 21 09:35:02.014546 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: from cryptography.utils import int_from_bytes Jan 21 09:35:02.015053 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jan 21 09:35:02.015053 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: from cryptography.utils import int_from_bytes Jan 21 09:35:04.520612 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jan 21 09:35:04.521568 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jan 21 09:35:04.521568 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jan 21 09:35:04.521851 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jan 21 09:35:04.522043 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jan 21 09:35:04.522404 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:35:04.522735 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:35:04.523060 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:35:04.523381 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:35:04.523712 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:35:04.524552 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:35:04.524947 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:35:04.525308 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:35:04.525676 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:35:04.526004 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:35:04.526448 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:35:04.526778 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-804035-25-iscsi {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:35:04.527104 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:35:04.527567 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:35:04.527903 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:35:04.528269 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:35:04.528585 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:35:04.528851 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jan 21 09:35:04.529286 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:35:04.529376 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jan 21 09:35:04.529450 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:35:04.529639 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jan 21 09:35:04.529828 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:35:04.531317 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jan 21 09:35:04.531317 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jan 21 09:35:04.531787 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:35:04.531787 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:35:04.532260 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:35:04.532485 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:35:04.532704 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:35:04.532704 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:35:04.533118 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:35:04.533395 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:35:04.533605 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:35:04.533814 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:35:04.534034 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:35:04.534245 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:35:04.534465 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:35:04.534694 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:35:04.534930 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:35:04.535175 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:35:04.535394 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:35:04.535612 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:35:04.535839 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:35:04.536162 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:35:04.536162 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:35:04.536559 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-804035-25-iscsi {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:35:04.536786 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-804035-25-iscsi {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:35:04.536945 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:35:04.537135 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:35:04.537320 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:35:04.537505 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:35:04.537689 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:35:04.537849 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:35:04.537849 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:35:04.538205 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:35:04.538381 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:35:04.538381 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:35:04.538664 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:35:04.538820 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:35:04.538998 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:35:04.539152 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:35:04.539314 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:35:04.539509 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:35:04.539771 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:35:04.539771 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:35:04.542237 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:35:04.542405 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:35:04.542555 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:35:04.542702 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:35:04.542702 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:35:04.542993 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:35:04.543148 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:35:04.543294 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:35:04.543449 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:35:04.543449 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:35:04.543751 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:35:04.543998 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:35:04.543998 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:35:04.544284 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:35:04.544427 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:35:04.544571 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:35:04.544715 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:35:04.544715 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:35:04.545077 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:35:04.545271 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:35:04.545433 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:35:04.545579 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:35:04.545744 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-804035-25-iscsi {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:35:04.545892 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:35:04.546043 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:35:04.546197 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:35:04.546346 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:35:04.546505 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:35:04.546505 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:35:04.546791 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:35:04.546936 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:35:04.547088 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:35:04.547243 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:35:04.547397 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:35:04.547559 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:35:04.547713 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:35:04.547871 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:35:04.548031 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:35:04.548185 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:35:04.548340 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:35:04.548493 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:35:04.548645 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:35:04.548790 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:35:04.548933 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:35:04.549195 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:35:04.549355 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:35:04.549515 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:35:04.549660 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:35:04.549821 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:35:04.550111 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:35:04.550282 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:35:04.550436 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:35:04.550587 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:35:04.550889 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:35:04.551647 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:35:04.551813 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:35:04.551961 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:35:04.552118 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:35:04.552272 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:35:04.552429 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:35:04.552581 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.45 {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:35:04.552740 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:35:04.552891 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.45 {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:35:04.553044 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:35:04.553218 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:35:04.553370 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:35:04.553559 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:35:04.553726 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:35:04.553886 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:35:04.554508 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:35:04.554676 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:35:04.554823 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:35:04.554997 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:35:04.555154 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:35:04.555154 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:35:04.555998 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:35:04.556219 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:35:04.556561 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:35:04.556809 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:35:04.556977 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:35:04.557187 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:35:04.557361 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:35:04.557518 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:35:04.557685 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:35:04.557968 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:35:04.558119 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:35:04.558272 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:35:04.558424 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:35:04.558570 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:35:04.558724 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:35:04.558869 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:35:04.559019 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:35:04.559175 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:35:04.559319 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:35:04.559471 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:35:04.559629 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:35:04.559629 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:35:04.559938 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:35:04.560102 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:35:04.560331 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:35:04.560490 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:35:04.560877 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:35:04.562452 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:35:04.562604 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:35:04.562758 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:35:04.562916 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:35:04.563108 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:35:04.563270 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.45 {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:35:04.563439 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:35:04.563603 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.45 {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:35:04.563603 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:35:04.563971 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:35:04.563971 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:35:04.564257 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:35:04.564402 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:35:04.564617 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:35:04.564776 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:35:04.564929 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:35:04.565083 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:35:04.565255 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:35:04.565413 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:35:04.565560 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:35:04.565724 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:35:04.565886 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:35:04.566039 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:35:04.566195 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:35:04.566340 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:35:04.566484 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:35:04.566627 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:35:04.566785 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:35:04.566941 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:35:04.567087 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:35:04.567258 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:35:04.567504 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:35:04.567675 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:35:04.567829 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:35:04.567983 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:35:04.568136 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:35:04.568295 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:35:04.568460 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:35:04.568614 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:35:04.568767 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:35:04.568922 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:35:04.569186 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:35:04.569362 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:35:04.569516 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:35:04.569661 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:35:04.569817 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:35:04.569817 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:35:04.569817 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:35:04.570236 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:35:04.570492 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:35:04.570653 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:35:04.570800 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:35:04.570800 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:35:04.571841 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:35:04.572873 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:35:04.573033 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:35:04.573214 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:35:04.573376 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:35:04.573548 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:35:04.573706 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:35:04.573861 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:35:04.574015 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:35:04.574015 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:35:04.574300 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:35:04.574452 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:35:04.574620 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:35:04.574779 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:35:04.574932 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:35:04.575085 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:35:04.575240 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:35:04.575394 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:35:04.575617 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:35:04.575773 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:35:04.575918 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:35:04.576069 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:35:04.576222 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:35:04.576378 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:35:04.576524 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:35:04.576667 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:35:04.576825 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:35:04.576970 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:35:04.577122 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:35:04.577294 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:35:04.577451 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:35:04.577615 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:35:04.577770 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:35:04.577922 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:35:04.578067 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:35:04.578218 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:35:04.578380 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:35:04.578530 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.578689 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:35:04.578834 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.578989 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:35:04.578989 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:35:04.579273 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.579443 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:35:04.579596 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.579751 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:35:04.579907 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.580061 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:35:04.580207 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.580366 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:35:04.580366 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:35:04.580756 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.580902 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:35:04.581046 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.581238 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:35:04.581398 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.581555 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:35:04.581709 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.581854 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:35:04.581999 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.583504 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:35:04.583674 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.583823 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:35:04.583968 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.584121 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:35:04.584275 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.584433 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:35:04.584588 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.584742 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:35:04.584899 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.585053 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:35:04.585219 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.585389 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:35:04.585537 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.585683 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:35:04.585829 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.585984 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jan 21 09:35:04.586138 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.586292 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.586503 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.586688 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.586871 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.587102 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.587349 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.587584 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.587769 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.587927 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.588082 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.588228 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.588404 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.588568 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.588722 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.588868 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.589013 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.589238 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.589401 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.589558 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.589704 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.589848 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.589993 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.590145 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.590290 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.590444 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.590616 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.590862 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.591015 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.591181 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.591340 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.591494 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.591638 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.591791 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.591936 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.592089 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.592267 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.592899 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.593057 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.593233 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.593427 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.593785 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.593953 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.594102 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.594255 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.594407 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.594560 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.594713 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.594867 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.595022 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.595169 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.595169 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.595463 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.595617 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.595806 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.595806 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.596105 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.596105 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.596403 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.596558 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.596711 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.596857 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.597011 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.597183 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.597348 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.597504 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.597657 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.597804 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.598010 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.598161 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.598326 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.598481 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.598627 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.598772 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.598915 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.599068 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.599223 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.599377 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.599530 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.599675 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.599842 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.599989 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.600217 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.600366 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.600511 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.600655 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.600807 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.601059 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.601297 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.601488 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.601681 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.601896 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.602085 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.602329 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.603369 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.603581 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.604040 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.604207 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.604364 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.604526 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.604683 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.604856 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.605016 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.605192 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.605363 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.605525 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.605684 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.605831 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.605976 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.606130 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.606275 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.606435 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.606590 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.606738 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.606889 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.607041 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.607194 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.607353 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.607499 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.607665 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.607813 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.607966 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.608126 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.608287 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.608434 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.608587 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.608734 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.608879 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.609032 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.609196 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.609356 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.609514 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.609659 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.609806 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.609965 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.610118 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.610272 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.610425 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.610571 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.610722 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.610883 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.611048 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.611291 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.611442 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.611604 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.611760 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.611913 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.612067 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.612219 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.614416 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.614596 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.614759 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.614918 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.615078 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.615233 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.615379 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.615531 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.615703 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.615858 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.616004 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.616158 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.616304 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.616455 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.616610 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.616756 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.616900 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.617045 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.617208 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.617359 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.617517 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.617517 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.618365 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.618518 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.618731 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.618979 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.619149 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.619306 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.619452 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.619452 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.619452 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.619452 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.620185 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.620436 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.620646 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.620796 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.620950 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.621112 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.621314 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.621619 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.621794 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.621956 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.622109 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.622269 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.622425 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.622579 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.622751 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.622918 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.623330 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.623713 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.623866 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.624011 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.624155 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.624509 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.624675 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.624823 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.624979 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.625134 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.625365 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.625526 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.625682 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.625828 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.625974 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.626118 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.626271 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.626423 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.626583 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.626730 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.626884 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.627040 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.627186 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.627332 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.627495 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.627654 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.627800 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.627945 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.628099 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.628262 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.628412 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.628558 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.628711 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.628857 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.629002 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.629178 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.629342 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.629498 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.629652 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.629807 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.629952 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.630107 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.630253 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.630398 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.630543 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.630688 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.630848 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.631003 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.631157 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.631309 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.631481 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.631742 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.631918 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.632071 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.632231 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.632383 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.632543 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.632703 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.632871 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.633033 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.634466 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.635065 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.635253 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.635411 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.635411 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.635717 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.635867 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.635867 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.636157 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.636308 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.636308 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.636692 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.636849 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.637001 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.637224 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.637407 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.637569 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.637720 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.637872 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.638031 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.638185 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.638549 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.638710 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.638876 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.639027 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.639180 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.639340 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.639509 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.639670 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.639829 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.639989 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.640148 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.640322 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.640484 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.640648 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.640800 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.640960 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.641111 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.641308 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.641463 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.641625 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.641885 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.642054 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.642221 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.642387 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.642539 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.642690 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.642848 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.643008 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.643177 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.643600 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.643762 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.643914 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.643914 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.644246 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.644674 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.645063 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.645257 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.645432 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.646172 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.646338 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.646338 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.646641 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.646641 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.646951 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.647121 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.647287 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.647287 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.647593 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.647746 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.647905 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.648057 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.648222 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.648374 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.648374 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.648374 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.648374 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.648964 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.649778 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.650027 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.650271 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.650529 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.650736 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.650893 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.651060 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.651213 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.651364 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.651364 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.651364 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.651364 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.651364 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.651364 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.651364 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.651364 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.652671 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.652671 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.652671 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.652671 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.652671 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.652671 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.652671 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.652671 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.654176 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.654176 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.654527 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.654980 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.655368 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.655533 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.655688 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.655840 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.655840 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.656158 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.656310 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.656468 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.656629 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.656790 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.656963 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.657118 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.657350 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.657506 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.657665 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.657818 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.658004 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.658221 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.658385 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.658548 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.658700 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.658861 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.659021 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.659021 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.659330 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.659483 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.659648 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.659809 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.659969 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.660131 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.660297 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.660456 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.660609 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.660775 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.660927 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.661078 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.661277 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.661431 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.661431 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.661728 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.661880 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.662050 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.662284 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.662442 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.662614 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.662776 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.662928 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.663079 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.663237 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.663405 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.663567 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.664067 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.664238 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.664400 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.664552 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.665415 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.665676 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.665920 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.666167 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.666374 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.666540 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.666540 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.666540 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.666540 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.666540 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.666540 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.666540 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.666540 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.667733 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.667733 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.667733 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.667733 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.667733 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.667733 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.667733 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.667733 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.668884 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.668884 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.668884 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.668884 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.669614 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.669774 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.669935 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.670086 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.670245 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.670411 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.670572 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.670743 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.670743 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.671047 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.671198 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.671356 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.671507 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.671666 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.671868 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.672026 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.672186 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.672441 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.672602 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.672764 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.672942 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.672942 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.673269 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.673423 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.673575 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.673745 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.674135 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.674305 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.674459 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.674620 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.674771 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.674944 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.675111 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.675264 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.675423 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.675575 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.675575 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.675876 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.675876 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.676164 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.676323 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.676475 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.676633 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.676798 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.676798 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.677111 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.677300 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.677465 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.677631 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.677783 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.677943 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.678096 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.678265 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.678418 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.678579 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.678730 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.678881 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.679034 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.679195 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.679346 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.679507 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.679672 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.679672 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.679976 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.680138 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.680527 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.680787 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.681058 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.681288 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.681455 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.681609 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.681783 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.681937 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.682088 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.682249 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.682428 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.682663 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.682832 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.682993 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.683145 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.683298 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.683457 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.683609 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.683774 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.683937 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.684331 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.684498 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.684661 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.685452 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.685615 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.685769 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.685921 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.686083 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.686236 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.686390 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.686594 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.686773 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.686936 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.687102 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.687263 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.687263 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.687566 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.687730 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.687882 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.688047 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.688207 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.688370 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.688534 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.688698 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.688848 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.689009 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.689236 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.689396 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.689561 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.689722 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.689979 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.689979 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.690286 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.690286 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.690574 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.690574 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.690892 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.691045 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.691208 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.691360 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.691360 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.691655 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.691816 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.691968 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.692125 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.692284 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.692436 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.692586 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.692864 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.693054 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.693228 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.693401 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.693554 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.693717 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.693895 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.693895 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.694539 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.694711 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.694874 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.695037 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.695198 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.695352 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.695523 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.695677 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.696442 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.696708 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.697341 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.697341 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.697772 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.697930 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.698120 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.698303 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.698612 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.698719 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.698807 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.698901 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.698998 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.699097 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.699184 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.699277 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.699371 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.699465 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.699560 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.699643 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.699783 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.699878 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.699966 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.700066 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.700237 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.700333 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.700421 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.700495 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.700574 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.700647 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.700647 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.700647 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.700647 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.700647 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.700647 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.700647 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.700647 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.701245 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.701245 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.701245 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.701245 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.701245 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.701245 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.701245 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.701245 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.701782 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.701782 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.701782 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.702017 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.702108 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.702193 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.702285 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.702285 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.702452 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.702538 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.702623 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.702715 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.702801 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.702968 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.703059 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.703153 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.703238 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.703331 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.703331 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.703503 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.703596 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.703693 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.703778 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.703862 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.703946 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.704044 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.704131 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.704216 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.704299 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.704467 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.704467 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.704799 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.704896 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.704982 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.705068 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.705180 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.705288 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.705383 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.705469 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.705561 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.705647 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.705738 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.705842 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.705842 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.705842 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.706074 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.706155 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.706155 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.706323 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.706410 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.706494 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.706494 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.706654 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.706737 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.706831 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.706918 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.707008 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.707093 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.707177 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.707273 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.707360 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.707444 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.707535 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.707629 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.707715 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.707812 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.707907 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.707993 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.707993 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.708159 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.708250 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.708350 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.708436 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.708523 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.708608 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.708701 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.708701 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.708872 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.708967 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.709053 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.709176 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.709269 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.709269 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.709413 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.709413 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.709562 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.709647 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.709741 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.709832 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.709832 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.709993 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.710078 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.710171 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.710265 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.710357 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.710445 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.710529 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.710613 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.710711 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.710797 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.710882 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.710967 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.711059 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.711145 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.711241 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.711328 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.711413 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.711413 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.712171 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.712278 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.712431 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.712582 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.712726 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.712879 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.713043 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.713275 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.713370 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.713455 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.713540 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.713636 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.713723 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.713822 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.713910 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.714002 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.714096 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.714181 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.714266 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.714364 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.714458 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.714552 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.714628 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.714726 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.714818 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.714917 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.715004 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.715090 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.715174 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.715396 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.715511 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.715723 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.715825 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.716063 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.716204 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.716384 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.716501 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.716718 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.716818 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.717056 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.717255 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.717514 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.717637 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.717854 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.718150 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.718255 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.718488 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.718585 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.718811 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.718909 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.719131 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.719235 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.719449 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.719559 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.719769 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.719872 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.720088 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.720191 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.720406 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.720515 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.720723 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.720828 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.721193 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.721305 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.721439 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.721569 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.721722 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.722012 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.722149 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.722348 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.722478 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.722666 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.722790 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.723003 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.723133 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.723320 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.723451 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.723655 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.723787 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.724025 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.724146 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.724350 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.724485 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.724743 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.724880 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.724997 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.725110 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.725452 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.725656 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.725790 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.725905 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.726017 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.726155 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.726370 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.726497 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.726619 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.726733 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.726954 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.728145 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.728303 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.728430 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.728430 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.728750 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.728874 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.729002 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.729173 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.729173 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.729411 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.729526 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.729656 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.729837 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.729960 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.730204 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.730339 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.730548 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.730662 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.730915 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.731007 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.731256 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.731358 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.731579 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.731673 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.731900 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.732209 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.732309 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.732530 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.732661 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.732853 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.732965 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.733200 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.733311 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.733530 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.733653 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.733849 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.734005 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.734169 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.734402 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.734500 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.734742 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.734911 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.735104 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.735234 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.735422 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.735520 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.735751 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.735910 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.736070 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.736164 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.736395 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.736525 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.736716 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.736823 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.737074 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.737225 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.737408 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.737510 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.737741 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.737839 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.738074 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.738177 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.738409 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.738611 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.738752 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.739229 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.739325 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.739554 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.739700 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.739887 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.739982 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.740219 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.740368 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.740544 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.740653 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.740859 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.741153 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.741249 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.741508 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.741610 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.741821 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.741924 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.742144 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.742245 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.742462 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.742610 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.742803 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.743424 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.743644 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.743954 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.744129 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.744296 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.744461 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.744680 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.744886 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.745002 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.745262 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.745385 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.745599 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.745700 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.745934 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.746042 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.746263 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.746365 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.746580 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.746687 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.746898 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.746992 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.747214 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.747327 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.747531 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.747627 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.747843 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.747937 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.748155 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.748327 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.748476 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.748578 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.748790 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.748901 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.749108 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.749257 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.749447 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.749650 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.749748 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.749991 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.750110 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.750390 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.750501 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.750653 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.750756 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.750983 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.751092 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.751296 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.751391 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.751606 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.751709 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.751930 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.752033 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.752248 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.752348 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.752575 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.752678 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.752894 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.752998 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.753254 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.753389 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.753584 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.753688 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.753913 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.754053 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.754243 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.754570 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.754693 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.754898 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.755105 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.755231 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.755346 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.755541 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.755672 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.755880 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.756111 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.756242 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.756365 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.756544 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.756762 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.756896 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.757012 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.757188 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.757427 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.757588 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.757707 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.757834 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.758066 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.758257 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.758697 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.759724 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.759864 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.760044 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.760250 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.760372 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.760610 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.760716 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.760968 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.761080 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.761350 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.761462 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.761696 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.761794 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.762048 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.762154 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.762382 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.762499 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.762705 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.762791 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.763036 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.763157 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.763365 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.763498 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.763690 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.763823 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.764032 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.764135 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.764362 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.764456 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.764688 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.764831 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.765055 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.765202 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.765418 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.765598 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.765737 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.766050 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.766201 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.766481 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.766582 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.766802 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.766915 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.767128 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.767239 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.767455 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.767553 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.767771 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.767868 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.768097 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.768195 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.768423 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.768542 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.768831 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.769181 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.769307 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.769515 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.769609 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.769832 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.769934 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.770156 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.770330 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.770506 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.770812 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.770914 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.771003 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.771100 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.771188 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.771407 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.771511 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.771733 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.771841 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.772044 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.772196 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.772360 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.772455 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.772685 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.772795 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.773007 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.773110 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.773350 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.773457 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.773684 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.773788 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.774250 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.774381 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.774381 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.774664 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.774833 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.774947 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.775044 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.775131 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.775283 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.775395 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.775606 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.775709 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.775920 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.776022 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.776258 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.776351 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.776576 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.776672 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.776897 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.777007 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.777236 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.777343 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.777543 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.777668 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.777959 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.778122 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.778279 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.778443 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.778600 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.778778 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.778932 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.779111 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.779259 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.779426 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.779596 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.779758 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.779926 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.780080 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.780252 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.780405 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.780618 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.780746 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.780959 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.781065 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.781381 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.781551 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.781702 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.781942 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.782044 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.782278 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.782383 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.782627 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.782729 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.782947 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.783042 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.783268 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.783372 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.783584 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.783688 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.783903 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.783998 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.784234 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.784336 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.784556 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.784656 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.784882 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.785033 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.785234 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.785368 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.786209 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.786291 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.786388 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.786462 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.786546 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.786620 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.786700 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.786793 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.787115 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.787438 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.787767 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.788122 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.788453 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.792658 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.792847 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.792847 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.793039 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.793039 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=123386) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jan 21 09:35:04.793284 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.793284 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.793284 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.793284 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.793284 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.793284 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.793284 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.793284 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.793872 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.793872 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.793872 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.793872 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.793872 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.794244 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.794494 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.794827 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.795182 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.795481 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.795806 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.796147 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.796504 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.796845 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.797208 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.797529 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.797848 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.798166 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.798489 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.798840 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.799183 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.799530 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.799863 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.800184 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.800518 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.800846 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.801204 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.801739 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.801903 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.802221 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.802562 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.802887 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.803211 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.803534 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.803858 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.804178 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.804500 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.804841 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.805200 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.806093 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.806442 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.806870 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.807093 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.807424 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.807747 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.808090 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.808415 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.808799 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.809055 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.809524 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.810420 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.810538 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.810868 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.811387 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.811722 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.812065 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.812464 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.812760 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.813121 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.813487 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.813817 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.814141 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.814461 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jan 21 09:35:04.814643 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_db.sqlalchemy.engines [None req-d38d44b3-f4e4-411e-81a1-6f04acf37b70 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123386) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 21 09:35:04.814756 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=123387) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jan 21 09:35:04.838621 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_db.sqlalchemy.engines [None req-ed0bff3c-b8e5-4ce1-be69-c514ebb2d1dd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123387) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 21 09:35:04.879587 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.context [None req-d38d44b3-f4e4-411e-81a1-6f04acf37b70 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),e6c51752-00e2-49a2-b378-b2153f241200(cell1) {{(pid=123386) load_cells /opt/stack/nova/nova/context.py:464}} Jan 21 09:35:04.883953 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-d38d44b3-f4e4-411e-81a1-6f04acf37b70 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:35:04.885562 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-d38d44b3-f4e4-411e-81a1-6f04acf37b70 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:35:04.886412 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-d38d44b3-f4e4-411e-81a1-6f04acf37b70 None None] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:35:04.888680 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-d38d44b3-f4e4-411e-81a1-6f04acf37b70 None None] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:35:04.899529 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_db.sqlalchemy.engines [None req-d38d44b3-f4e4-411e-81a1-6f04acf37b70 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123386) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 21 09:35:04.902037 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_db.sqlalchemy.engines [None req-d38d44b3-f4e4-411e-81a1-6f04acf37b70 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123386) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 21 09:35:04.909411 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.context [None req-ed0bff3c-b8e5-4ce1-be69-c514ebb2d1dd None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),e6c51752-00e2-49a2-b378-b2153f241200(cell1) {{(pid=123387) load_cells /opt/stack/nova/nova/context.py:464}} Jan 21 09:35:04.913942 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-ed0bff3c-b8e5-4ce1-be69-c514ebb2d1dd None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:35:04.916868 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-ed0bff3c-b8e5-4ce1-be69-c514ebb2d1dd None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:35:04.917754 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-ed0bff3c-b8e5-4ce1-be69-c514ebb2d1dd None None] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:35:04.919901 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-ed0bff3c-b8e5-4ce1-be69-c514ebb2d1dd None None] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:35:04.931517 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_db.sqlalchemy.engines [None req-ed0bff3c-b8e5-4ce1-be69-c514ebb2d1dd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123387) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 21 09:35:04.935155 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_db.sqlalchemy.engines [None req-ed0bff3c-b8e5-4ce1-be69-c514ebb2d1dd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123387) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 21 09:35:05.063246 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_db.sqlalchemy.engines [None req-d38d44b3-f4e4-411e-81a1-6f04acf37b70 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123386) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 21 09:35:05.105323 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_db.sqlalchemy.engines [None req-ed0bff3c-b8e5-4ce1-be69-c514ebb2d1dd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123387) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jan 21 09:35:05.389161 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: WARNING keystonemiddleware.auth_token [None req-d38d44b3-f4e4-411e-81a1-6f04acf37b70 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 21 09:35:05.395798 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: WARNING keystonemiddleware.auth_token [None req-d38d44b3-f4e4-411e-81a1-6f04acf37b70 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 21 09:35:05.440039 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: WARNING keystonemiddleware.auth_token [None req-ed0bff3c-b8e5-4ce1-be69-c514ebb2d1dd None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 21 09:35:05.447744 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: WARNING keystonemiddleware.auth_token [None req-ed0bff3c-b8e5-4ce1-be69-c514ebb2d1dd None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 21 09:35:05.743967 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: WARNING keystonemiddleware.auth_token [None req-d38d44b3-f4e4-411e-81a1-6f04acf37b70 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 21 09:35:05.749566 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: WARNING keystonemiddleware.auth_token [None req-d38d44b3-f4e4-411e-81a1-6f04acf37b70 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 21 09:35:05.757912 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5571b244e9c0 pid: 123386 (default app) Jan 21 09:35:05.796774 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: WARNING keystonemiddleware.auth_token [None req-ed0bff3c-b8e5-4ce1-be69-c514ebb2d1dd None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jan 21 09:35:05.801981 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: WARNING keystonemiddleware.auth_token [None req-ed0bff3c-b8e5-4ce1-be69-c514ebb2d1dd None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jan 21 09:35:05.807957 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5571b244e9c0 pid: 123387 (default app) Jan 21 09:35:46.870052 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-7aa48bff-035c-4b0c-b2c3-72d20d0c8fc1 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-312788504", "imageRef": "813e53ee-82e7-4a13-9f63-a8be7b1089f1", "flavorRef": "452", "networks": [{"uuid": "6d3bfab5-614b-42ce-87b9-03bdb3f3c1da"}]}} {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:35:47.038508 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-5b8da1da-2144-4b86-b45d-b6342eddf8ea tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1839349080", "imageRef": "813e53ee-82e7-4a13-9f63-a8be7b1089f1", "flavorRef": "452", "networks": [{"uuid": "4b308458-76e4-44e0-92a9-9be5555db9bc"}]}} {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:35:47.353502 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.network.neutron [None req-7aa48bff-035c-4b0c-b2c3-72d20d0c8fc1 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] validate_networks() for [('6d3bfab5-614b-42ce-87b9-03bdb3f3c1da', None, None, None, None, None)] {{(pid=123386) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 21 09:35:47.375041 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.network.neutron [None req-5b8da1da-2144-4b86-b45d-b6342eddf8ea tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] validate_networks() for [('4b308458-76e4-44e0-92a9-9be5555db9bc', None, None, None, None, None)] {{(pid=123387) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 21 09:35:49.444884 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.virt.hardware [None req-7aa48bff-035c-4b0c-b2c3-72d20d0c8fc1 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Flavor limits 0:0:0 {{(pid=123386) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 21 09:35:49.446297 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.virt.hardware [None req-7aa48bff-035c-4b0c-b2c3-72d20d0c8fc1 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Image limits 0:0:0 {{(pid=123386) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 21 09:35:49.447157 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.virt.hardware [None req-7aa48bff-035c-4b0c-b2c3-72d20d0c8fc1 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Flavor pref 0:0:0 {{(pid=123386) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 21 09:35:49.447791 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.virt.hardware [None req-7aa48bff-035c-4b0c-b2c3-72d20d0c8fc1 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Image pref 0:0:0 {{(pid=123386) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 21 09:35:49.448445 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.virt.hardware [None req-7aa48bff-035c-4b0c-b2c3-72d20d0c8fc1 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123386) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 21 09:35:49.478342 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-7aa48bff-035c-4b0c-b2c3-72d20d0c8fc1 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:35:49.478342 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-7aa48bff-035c-4b0c-b2c3-72d20d0c8fc1 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:35:49.478342 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-7aa48bff-035c-4b0c-b2c3-72d20d0c8fc1 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:35:49.478342 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-7aa48bff-035c-4b0c-b2c3-72d20d0c8fc1 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:35:49.492720 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.virt.hardware [None req-5b8da1da-2144-4b86-b45d-b6342eddf8ea tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Flavor limits 0:0:0 {{(pid=123387) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 21 09:35:49.493441 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.virt.hardware [None req-5b8da1da-2144-4b86-b45d-b6342eddf8ea tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Image limits 0:0:0 {{(pid=123387) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 21 09:35:49.493918 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.virt.hardware [None req-5b8da1da-2144-4b86-b45d-b6342eddf8ea tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Flavor pref 0:0:0 {{(pid=123387) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 21 09:35:49.494320 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.virt.hardware [None req-5b8da1da-2144-4b86-b45d-b6342eddf8ea tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Image pref 0:0:0 {{(pid=123387) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 21 09:35:49.494743 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.virt.hardware [None req-5b8da1da-2144-4b86-b45d-b6342eddf8ea tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123387) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 21 09:35:49.526475 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.quota [None req-7aa48bff-035c-4b0c-b2c3-72d20d0c8fc1 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Getting quotas for project e3390729231b409e9a83376b428c1a7f. Resources: {'cores', 'instances', 'ram'} {{(pid=123386) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 21 09:35:49.539014 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.quota [None req-7aa48bff-035c-4b0c-b2c3-72d20d0c8fc1 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Getting quotas for user fc7b2c14d9444d65ab7a874e749671bb and project e3390729231b409e9a83376b428c1a7f. Resources: {'cores', 'instances', 'ram'} {{(pid=123386) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 21 09:35:49.544987 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-5b8da1da-2144-4b86-b45d-b6342eddf8ea tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:35:49.545551 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-5b8da1da-2144-4b86-b45d-b6342eddf8ea tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:35:49.546417 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-5b8da1da-2144-4b86-b45d-b6342eddf8ea tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:35:49.546957 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-5b8da1da-2144-4b86-b45d-b6342eddf8ea tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:35:49.561858 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-7aa48bff-035c-4b0c-b2c3-72d20d0c8fc1 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Going to run 1 instances... {{(pid=123386) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 21 09:35:49.569270 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-7aa48bff-035c-4b0c-b2c3-72d20d0c8fc1 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] [instance: 370b78d2-d154-4c93-b8ef-3723bd26c3d4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='813e53ee-82e7-4a13-9f63-a8be7b1089f1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123386) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 21 09:35:49.657990 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.quota [None req-5b8da1da-2144-4b86-b45d-b6342eddf8ea tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Getting quotas for project 22a31f7136c241578473d4d323722c69. Resources: {'cores', 'instances', 'ram'} {{(pid=123387) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 21 09:35:49.670277 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.quota [None req-5b8da1da-2144-4b86-b45d-b6342eddf8ea tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Getting quotas for user 83b547a45bb54a8f94e9e5f5aeba7520 and project 22a31f7136c241578473d4d323722c69. Resources: {'cores', 'instances', 'ram'} {{(pid=123387) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 21 09:35:49.684875 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-5b8da1da-2144-4b86-b45d-b6342eddf8ea tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Going to run 1 instances... {{(pid=123387) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 21 09:35:49.701785 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-5b8da1da-2144-4b86-b45d-b6342eddf8ea tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] [instance: b50feb40-c691-4724-8570-f5873bdc5d1e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='813e53ee-82e7-4a13-9f63-a8be7b1089f1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123387) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 21 09:35:49.761346 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-7aa48bff-035c-4b0c-b2c3-72d20d0c8fc1 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.450630 Jan 21 09:35:49.767933 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 1/1] 10.222.0.45 () {60 vars in 1146 bytes} [Fri Jan 21 09:35:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 3459 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 21 09:35:49.775276 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-a4118bdc-f43b-4ebc-8af0-94e6f8e95b5d tempest-VolumesTestJSON-1470128856 tempest-VolumesTestJSON-1470128856-project] Calling method '.version_select at 0x7fb6c8a0f820>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:35:49.884882 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-a4118bdc-f43b-4ebc-8af0-94e6f8e95b5d tempest-VolumesTestJSON-1470128856 tempest-VolumesTestJSON-1470128856-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/d5486c19-c970-4990-a45a-49e05cd87fff" status: 200 len: 351 microversion: 2.1 time: 0.115467 Jan 21 09:35:49.892995 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 2/2] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Jan 21 09:35:49 2022] GET /compute/v2.1/os-volumes/d5486c19-c970-4990-a45a-49e05cd87fff => generated 351 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 09:35:49.899830 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-8fd32537-67cf-4535-9604-1d920f55d112 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:35:49.900790 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-8fd32537-67cf-4535-9604-1d920f55d112 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] [instance: 370b78d2-d154-4c93-b8ef-3723bd26c3d4] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:35:49.924086 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-5b8da1da-2144-4b86-b45d-b6342eddf8ea tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.500549 Jan 21 09:35:49.925451 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 1/3] 10.222.0.45 () {60 vars in 1146 bytes} [Fri Jan 21 09:35:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 3505 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 21 09:35:49.939568 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-1e85649f-462b-4582-98eb-b14d2dee4e5b tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:35:49.941104 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-1e85649f-462b-4582-98eb-b14d2dee4e5b tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] [instance: b50feb40-c691-4724-8570-f5873bdc5d1e] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:35:50.138189 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-8fd32537-67cf-4535-9604-1d920f55d112 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7b2c14d9444d65ab7a874e749671bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3390729231b409e9a83376b428c1a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:35:50.140655 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-1e85649f-462b-4582-98eb-b14d2dee4e5b tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b547a45bb54a8f94e9e5f5aeba7520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a31f7136c241578473d4d323722c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:35:50.157076 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-1e85649f-462b-4582-98eb-b14d2dee4e5b tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] 10.222.0.45 "GET /compute/v2.1/servers/b50feb40-c691-4724-8570-f5873bdc5d1e" status: 200 len: 1215 microversion: 2.1 time: 0.223529 Jan 21 09:35:50.158360 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 2/4] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:35:49 2022] GET /compute/v2.1/servers/b50feb40-c691-4724-8570-f5873bdc5d1e => generated 1215 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:35:50.172941 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-8fd32537-67cf-4535-9604-1d920f55d112 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] 10.222.0.45 "GET /compute/v2.1/servers/370b78d2-d154-4c93-b8ef-3723bd26c3d4" status: 200 len: 1217 microversion: 2.1 time: 0.277327 Jan 21 09:35:50.174692 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 3/5] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:35:49 2022] GET /compute/v2.1/servers/370b78d2-d154-4c93-b8ef-3723bd26c3d4 => generated 1217 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:35:51.177950 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-09a81f73-8648-4471-90f8-444ae820cde3 tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:35:51.178536 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-09a81f73-8648-4471-90f8-444ae820cde3 tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] [instance: b50feb40-c691-4724-8570-f5873bdc5d1e] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:35:51.198457 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-ccb6d652-2799-41ad-97f4-3b28274e865f tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:35:51.199122 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-ccb6d652-2799-41ad-97f4-3b28274e865f tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] [instance: 370b78d2-d154-4c93-b8ef-3723bd26c3d4] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:35:51.340797 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-09a81f73-8648-4471-90f8-444ae820cde3 tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b547a45bb54a8f94e9e5f5aeba7520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a31f7136c241578473d4d323722c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:35:51.348973 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-09a81f73-8648-4471-90f8-444ae820cde3 tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] 10.222.0.45 "GET /compute/v2.1/servers/b50feb40-c691-4724-8570-f5873bdc5d1e" status: 200 len: 1215 microversion: 2.1 time: 0.177233 Jan 21 09:35:51.349614 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 3/6] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:35:51 2022] GET /compute/v2.1/servers/b50feb40-c691-4724-8570-f5873bdc5d1e => generated 1215 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 09:35:51.427755 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-ccb6d652-2799-41ad-97f4-3b28274e865f tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7b2c14d9444d65ab7a874e749671bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3390729231b409e9a83376b428c1a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:35:51.689237 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-ccb6d652-2799-41ad-97f4-3b28274e865f tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] 10.222.0.45 "GET /compute/v2.1/servers/370b78d2-d154-4c93-b8ef-3723bd26c3d4" status: 200 len: 1217 microversion: 2.1 time: 0.244744 Jan 21 09:35:51.689237 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 4/7] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:35:51 2022] GET /compute/v2.1/servers/370b78d2-d154-4c93-b8ef-3723bd26c3d4 => generated 1217 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:35:52.377960 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-5b45c9af-68ee-4f71-b95e-b76681e051d4 tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:35:52.377960 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-5b45c9af-68ee-4f71-b95e-b76681e051d4 tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] [instance: b50feb40-c691-4724-8570-f5873bdc5d1e] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:35:52.463376 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-5b52dd36-2131-46d9-9f82-9ceb79830899 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:35:52.464067 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-5b52dd36-2131-46d9-9f82-9ceb79830899 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] [instance: 370b78d2-d154-4c93-b8ef-3723bd26c3d4] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:35:52.543570 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-5b45c9af-68ee-4f71-b95e-b76681e051d4 tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b547a45bb54a8f94e9e5f5aeba7520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a31f7136c241578473d4d323722c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:35:52.561129 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-5b45c9af-68ee-4f71-b95e-b76681e051d4 tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] 10.222.0.45 "GET /compute/v2.1/servers/b50feb40-c691-4724-8570-f5873bdc5d1e" status: 200 len: 1215 microversion: 2.1 time: 0.196923 Jan 21 09:35:52.567837 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 4/8] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:35:52 2022] GET /compute/v2.1/servers/b50feb40-c691-4724-8570-f5873bdc5d1e => generated 1215 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 09:35:52.626794 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-3363ce84-d22c-4ffa-8001-70828822ba95 tempest-VolumesTestJSON-1470128856 tempest-VolumesTestJSON-1470128856-project] Calling method '.version_select at 0x7fb6c815bc10>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:35:52.640887 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-5b52dd36-2131-46d9-9f82-9ceb79830899 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7b2c14d9444d65ab7a874e749671bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3390729231b409e9a83376b428c1a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:35:52.648493 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-5b52dd36-2131-46d9-9f82-9ceb79830899 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] 10.222.0.45 "GET /compute/v2.1/servers/370b78d2-d154-4c93-b8ef-3723bd26c3d4" status: 200 len: 1217 microversion: 2.1 time: 0.191583 Jan 21 09:35:52.649857 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 5/9] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:35:52 2022] GET /compute/v2.1/servers/370b78d2-d154-4c93-b8ef-3723bd26c3d4 => generated 1217 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:35:52.784687 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-3363ce84-d22c-4ffa-8001-70828822ba95 tempest-VolumesTestJSON-1470128856 tempest-VolumesTestJSON-1470128856-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/5c5fe6fc-bb99-4f74-831a-13aba77c36a0" status: 200 len: 351 microversion: 2.1 time: 0.161929 Jan 21 09:35:52.785281 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 5/10] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Jan 21 09:35:52 2022] GET /compute/v2.1/os-volumes/5c5fe6fc-bb99-4f74-831a-13aba77c36a0 => generated 351 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 09:35:53.588557 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-bbb5f7ec-9d8b-48d7-bea2-971d070590be tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:35:53.589685 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-bbb5f7ec-9d8b-48d7-bea2-971d070590be tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] [instance: b50feb40-c691-4724-8570-f5873bdc5d1e] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:35:53.597952 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-bbb5f7ec-9d8b-48d7-bea2-971d070590be tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:35:53.619661 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-bbb5f7ec-9d8b-48d7-bea2-971d070590be tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:35:53.630398 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-bbb5f7ec-9d8b-48d7-bea2-971d070590be tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:35:53.630398 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-bbb5f7ec-9d8b-48d7-bea2-971d070590be tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:35:54.034455 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-a97acc6a-cf70-4e7e-85e8-69f2e47fad33 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-713568328", "imageRef": "813e53ee-82e7-4a13-9f63-a8be7b1089f1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:35:54.046069 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-bbb5f7ec-9d8b-48d7-bea2-971d070590be tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b547a45bb54a8f94e9e5f5aeba7520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a31f7136c241578473d4d323722c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:35:54.082962 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-bbb5f7ec-9d8b-48d7-bea2-971d070590be tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] 10.222.0.45 "GET /compute/v2.1/servers/b50feb40-c691-4724-8570-f5873bdc5d1e" status: 200 len: 1219 microversion: 2.1 time: 0.498108 Jan 21 09:35:54.083576 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 6/11] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:35:53 2022] GET /compute/v2.1/servers/b50feb40-c691-4724-8570-f5873bdc5d1e => generated 1219 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:35:54.097092 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-f2ed977e-8560-4903-beca-d53582c06cb8 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:35:54.100832 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-f2ed977e-8560-4903-beca-d53582c06cb8 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] [instance: 370b78d2-d154-4c93-b8ef-3723bd26c3d4] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:35:54.144239 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-f2ed977e-8560-4903-beca-d53582c06cb8 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:35:54.145546 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-f2ed977e-8560-4903-beca-d53582c06cb8 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:35:54.146308 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-f2ed977e-8560-4903-beca-d53582c06cb8 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:35:54.147039 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-f2ed977e-8560-4903-beca-d53582c06cb8 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:35:54.167271 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.network.neutron [None req-a97acc6a-cf70-4e7e-85e8-69f2e47fad33 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] validate_networks() for [('d8632307-2281-4a7d-8be2-4fe34d09fe87', None, None, None, None, None)] {{(pid=123386) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 21 09:35:54.287799 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-f2ed977e-8560-4903-beca-d53582c06cb8 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7b2c14d9444d65ab7a874e749671bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3390729231b409e9a83376b428c1a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:35:54.301602 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-f2ed977e-8560-4903-beca-d53582c06cb8 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] 10.222.0.45 "GET /compute/v2.1/servers/370b78d2-d154-4c93-b8ef-3723bd26c3d4" status: 200 len: 1221 microversion: 2.1 time: 0.211728 Jan 21 09:35:54.308084 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 7/12] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:35:54 2022] GET /compute/v2.1/servers/370b78d2-d154-4c93-b8ef-3723bd26c3d4 => generated 1221 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:35:54.642961 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-084ad627-f945-4d4b-80bf-28a04aede361 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Action: 'create', calling method: .version_select at 0x7fb6c8b9f5e0>, body: {"keypair": {"name": "tempest-keypair-367654863"}} {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:35:54.701931 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.quota [None req-084ad627-f945-4d4b-80bf-28a04aede361 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Getting quotas for project 93281ac9cb504124a055279296f2262f. Resources: {'key_pairs'} {{(pid=123387) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 21 09:35:54.708933 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.quota [None req-084ad627-f945-4d4b-80bf-28a04aede361 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Getting quotas for user c190858354e14533a06a1fac88f2cfd3 and project 93281ac9cb504124a055279296f2262f. Resources: {'key_pairs'} {{(pid=123387) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 21 09:35:54.767143 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.virt.hardware [None req-a97acc6a-cf70-4e7e-85e8-69f2e47fad33 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Flavor limits 0:0:0 {{(pid=123386) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 21 09:35:54.767780 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.virt.hardware [None req-a97acc6a-cf70-4e7e-85e8-69f2e47fad33 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Image limits 0:0:0 {{(pid=123386) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 21 09:35:54.768169 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.virt.hardware [None req-a97acc6a-cf70-4e7e-85e8-69f2e47fad33 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Flavor pref 0:0:0 {{(pid=123386) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 21 09:35:54.768671 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.virt.hardware [None req-a97acc6a-cf70-4e7e-85e8-69f2e47fad33 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Image pref 0:0:0 {{(pid=123386) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 21 09:35:54.769101 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.virt.hardware [None req-a97acc6a-cf70-4e7e-85e8-69f2e47fad33 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123386) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 21 09:35:54.791904 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-a97acc6a-cf70-4e7e-85e8-69f2e47fad33 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:35:54.792791 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-a97acc6a-cf70-4e7e-85e8-69f2e47fad33 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:35:54.793936 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-a97acc6a-cf70-4e7e-85e8-69f2e47fad33 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:35:54.794602 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-a97acc6a-cf70-4e7e-85e8-69f2e47fad33 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:35:54.826276 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.quota [None req-a97acc6a-cf70-4e7e-85e8-69f2e47fad33 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Getting quotas for project 5f89d1b21ad8471a8a9a82adac2594c1. Resources: {'cores', 'instances', 'ram'} {{(pid=123386) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 21 09:35:54.830980 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.quota [None req-a97acc6a-cf70-4e7e-85e8-69f2e47fad33 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Getting quotas for user db87258db1424ce7a8399fdd05efe3b4 and project 5f89d1b21ad8471a8a9a82adac2594c1. Resources: {'cores', 'instances', 'ram'} {{(pid=123386) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 21 09:35:54.854594 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-a97acc6a-cf70-4e7e-85e8-69f2e47fad33 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Going to run 1 instances... {{(pid=123386) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 21 09:35:54.857282 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-a97acc6a-cf70-4e7e-85e8-69f2e47fad33 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] [instance: 4e67b25e-7e65-4975-bafa-fceafcd53647] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='813e53ee-82e7-4a13-9f63-a8be7b1089f1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123386) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 21 09:35:55.001095 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-a97acc6a-cf70-4e7e-85e8-69f2e47fad33 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.688771 Jan 21 09:35:55.002606 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 6/13] 10.222.0.45 () {60 vars in 1146 bytes} [Fri Jan 21 09:35:53 2022] POST /compute/v2.1/servers => generated 383 bytes in 1694 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 21 09:35:55.013967 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-7eb85f0f-1cf7-42f5-8f86-21d3daca9b34 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:35:55.015869 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-7eb85f0f-1cf7-42f5-8f86-21d3daca9b34 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] [instance: 4e67b25e-7e65-4975-bafa-fceafcd53647] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:35:55.084594 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-7eb85f0f-1cf7-42f5-8f86-21d3daca9b34 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db87258db1424ce7a8399fdd05efe3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89d1b21ad8471a8a9a82adac2594c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:35:55.093262 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-7eb85f0f-1cf7-42f5-8f86-21d3daca9b34 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] 10.222.0.45 "GET /compute/v2.1/servers/4e67b25e-7e65-4975-bafa-fceafcd53647" status: 200 len: 1221 microversion: 2.1 time: 0.082982 Jan 21 09:35:55.103816 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 7/14] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:35:55 2022] GET /compute/v2.1/servers/4e67b25e-7e65-4975-bafa-fceafcd53647 => generated 1221 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:35:55.109377 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-49bca426-8380-4014-b39b-1d79fc3cf061 tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:35:55.109710 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-49bca426-8380-4014-b39b-1d79fc3cf061 tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] [instance: b50feb40-c691-4724-8570-f5873bdc5d1e] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:35:55.128817 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-49bca426-8380-4014-b39b-1d79fc3cf061 tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:35:55.129298 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-49bca426-8380-4014-b39b-1d79fc3cf061 tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:35:55.130100 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-49bca426-8380-4014-b39b-1d79fc3cf061 tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:35:55.130596 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-49bca426-8380-4014-b39b-1d79fc3cf061 tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:35:55.370852 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-49bca426-8380-4014-b39b-1d79fc3cf061 tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b547a45bb54a8f94e9e5f5aeba7520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a31f7136c241578473d4d323722c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:35:55.378443 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.quota [None req-084ad627-f945-4d4b-80bf-28a04aede361 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Getting quotas for project 93281ac9cb504124a055279296f2262f. Resources: {'key_pairs'} {{(pid=123387) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 21 09:35:55.378552 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-49bca426-8380-4014-b39b-1d79fc3cf061 tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] 10.222.0.45 "GET /compute/v2.1/servers/b50feb40-c691-4724-8570-f5873bdc5d1e" status: 200 len: 1219 microversion: 2.1 time: 0.265277 Jan 21 09:35:55.378552 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 8/15] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:35:55 2022] GET /compute/v2.1/servers/b50feb40-c691-4724-8570-f5873bdc5d1e => generated 1219 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:35:55.378552 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-0c94ebe0-bb1f-4325-ac8c-18b067928aca tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-2035496065", "imageRef": "813e53ee-82e7-4a13-9f63-a8be7b1089f1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:35:55.381681 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.quota [None req-084ad627-f945-4d4b-80bf-28a04aede361 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Getting quotas for user c190858354e14533a06a1fac88f2cfd3 and project 93281ac9cb504124a055279296f2262f. Resources: {'key_pairs'} {{(pid=123387) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 21 09:35:55.407992 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-084ad627-f945-4d4b-80bf-28a04aede361 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 201 len: 2315 microversion: 2.20 time: 1.096265 Jan 21 09:35:55.415638 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 8/16] 10.222.0.45 () {62 vars in 1198 bytes} [Fri Jan 21 09:35:54 2022] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 1098 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Jan 21 09:35:55.424519 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-fcb5634f-0fb7-4d16-8629-5d3317193aec tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:35:55.426133 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-fcb5634f-0fb7-4d16-8629-5d3317193aec tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] [instance: 370b78d2-d154-4c93-b8ef-3723bd26c3d4] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:35:55.442715 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-fcb5634f-0fb7-4d16-8629-5d3317193aec tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:35:55.443684 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-fcb5634f-0fb7-4d16-8629-5d3317193aec tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:35:55.445364 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-fcb5634f-0fb7-4d16-8629-5d3317193aec tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:35:55.446740 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-fcb5634f-0fb7-4d16-8629-5d3317193aec tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:35:55.467120 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.network.neutron [None req-0c94ebe0-bb1f-4325-ac8c-18b067928aca tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] validate_networks() for [('d8632307-2281-4a7d-8be2-4fe34d09fe87', None, None, None, None, None)] {{(pid=123386) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 21 09:35:55.657006 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-fcb5634f-0fb7-4d16-8629-5d3317193aec tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7b2c14d9444d65ab7a874e749671bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3390729231b409e9a83376b428c1a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:35:55.683092 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-fcb5634f-0fb7-4d16-8629-5d3317193aec tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] 10.222.0.45 "GET /compute/v2.1/servers/370b78d2-d154-4c93-b8ef-3723bd26c3d4" status: 200 len: 1221 microversion: 2.1 time: 0.268558 Jan 21 09:35:55.701533 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 9/17] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:35:55 2022] GET /compute/v2.1/servers/370b78d2-d154-4c93-b8ef-3723bd26c3d4 => generated 1221 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:35:56.395635 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-d05a92e7-c0fe-4c81-a0be-6a25ee101531 tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:35:56.402123 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-d05a92e7-c0fe-4c81-a0be-6a25ee101531 tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] [instance: b50feb40-c691-4724-8570-f5873bdc5d1e] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:35:56.428766 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-d05a92e7-c0fe-4c81-a0be-6a25ee101531 tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:35:56.432371 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-d05a92e7-c0fe-4c81-a0be-6a25ee101531 tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:35:56.438829 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-d05a92e7-c0fe-4c81-a0be-6a25ee101531 tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:35:56.440849 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-d05a92e7-c0fe-4c81-a0be-6a25ee101531 tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:35:56.538575 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.virt.hardware [None req-0c94ebe0-bb1f-4325-ac8c-18b067928aca tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Flavor limits 0:0:0 {{(pid=123386) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 21 09:35:56.539782 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.virt.hardware [None req-0c94ebe0-bb1f-4325-ac8c-18b067928aca tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Image limits 0:0:0 {{(pid=123386) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 21 09:35:56.540414 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.virt.hardware [None req-0c94ebe0-bb1f-4325-ac8c-18b067928aca tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Flavor pref 0:0:0 {{(pid=123386) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 21 09:35:56.541007 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.virt.hardware [None req-0c94ebe0-bb1f-4325-ac8c-18b067928aca tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Image pref 0:0:0 {{(pid=123386) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 21 09:35:56.541592 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.virt.hardware [None req-0c94ebe0-bb1f-4325-ac8c-18b067928aca tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123386) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 21 09:35:56.560994 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-0c94ebe0-bb1f-4325-ac8c-18b067928aca tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:35:56.561480 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-0c94ebe0-bb1f-4325-ac8c-18b067928aca tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:35:56.562358 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-0c94ebe0-bb1f-4325-ac8c-18b067928aca tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:35:56.562730 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-0c94ebe0-bb1f-4325-ac8c-18b067928aca tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:35:56.583635 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.quota [None req-0c94ebe0-bb1f-4325-ac8c-18b067928aca tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Getting quotas for project 5f89d1b21ad8471a8a9a82adac2594c1. Resources: {'cores', 'instances', 'ram'} {{(pid=123386) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 21 09:35:56.589039 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.quota [None req-0c94ebe0-bb1f-4325-ac8c-18b067928aca tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Getting quotas for user db87258db1424ce7a8399fdd05efe3b4 and project 5f89d1b21ad8471a8a9a82adac2594c1. Resources: {'cores', 'instances', 'ram'} {{(pid=123386) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 21 09:35:56.603001 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-d05a92e7-c0fe-4c81-a0be-6a25ee101531 tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b547a45bb54a8f94e9e5f5aeba7520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a31f7136c241578473d4d323722c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:35:56.603163 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-0c94ebe0-bb1f-4325-ac8c-18b067928aca tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Going to run 1 instances... {{(pid=123386) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 21 09:35:56.605078 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-0c94ebe0-bb1f-4325-ac8c-18b067928aca tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] [instance: 06ae865a-6ba5-4198-be6d-e6056e645411] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='813e53ee-82e7-4a13-9f63-a8be7b1089f1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123386) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 21 09:35:56.608394 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-d05a92e7-c0fe-4c81-a0be-6a25ee101531 tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] 10.222.0.45 "GET /compute/v2.1/servers/b50feb40-c691-4724-8570-f5873bdc5d1e" status: 200 len: 1211 microversion: 2.1 time: 0.220144 Jan 21 09:35:56.609668 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 10/18] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:35:56 2022] GET /compute/v2.1/servers/b50feb40-c691-4724-8570-f5873bdc5d1e => generated 1211 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:35:56.708614 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-c3e1415f-e240-4111-94b6-8b1f0bac11f2 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:35:56.714071 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-c3e1415f-e240-4111-94b6-8b1f0bac11f2 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] [instance: 370b78d2-d154-4c93-b8ef-3723bd26c3d4] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:35:56.733481 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-c3e1415f-e240-4111-94b6-8b1f0bac11f2 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:35:56.748068 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-c3e1415f-e240-4111-94b6-8b1f0bac11f2 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:35:56.748068 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-c3e1415f-e240-4111-94b6-8b1f0bac11f2 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:35:56.748068 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-c3e1415f-e240-4111-94b6-8b1f0bac11f2 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:35:56.797988 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-0c94ebe0-bb1f-4325-ac8c-18b067928aca tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.425099 Jan 21 09:35:56.798647 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 9/19] 10.222.0.45 () {60 vars in 1146 bytes} [Fri Jan 21 09:35:55 2022] POST /compute/v2.1/servers => generated 383 bytes in 1427 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 21 09:35:56.810119 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-dc1ca30b-dbc5-4520-865e-a2932dc463f2 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:35:56.815223 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-dc1ca30b-dbc5-4520-865e-a2932dc463f2 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] [instance: 06ae865a-6ba5-4198-be6d-e6056e645411] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:35:56.941404 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-dc1ca30b-dbc5-4520-865e-a2932dc463f2 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db87258db1424ce7a8399fdd05efe3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89d1b21ad8471a8a9a82adac2594c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:35:56.952871 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-dc1ca30b-dbc5-4520-865e-a2932dc463f2 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] 10.222.0.45 "GET /compute/v2.1/servers/06ae865a-6ba5-4198-be6d-e6056e645411" status: 200 len: 1222 microversion: 2.1 time: 0.144666 Jan 21 09:35:56.965924 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 10/20] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:35:56 2022] GET /compute/v2.1/servers/06ae865a-6ba5-4198-be6d-e6056e645411 => generated 1222 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:35:57.002207 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-c3e1415f-e240-4111-94b6-8b1f0bac11f2 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7b2c14d9444d65ab7a874e749671bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3390729231b409e9a83376b428c1a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:35:57.011380 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-c3e1415f-e240-4111-94b6-8b1f0bac11f2 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] 10.222.0.45 "GET /compute/v2.1/servers/370b78d2-d154-4c93-b8ef-3723bd26c3d4" status: 200 len: 1213 microversion: 2.1 time: 0.306309 Jan 21 09:35:57.011966 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 11/21] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:35:56 2022] GET /compute/v2.1/servers/370b78d2-d154-4c93-b8ef-3723bd26c3d4 => generated 1213 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 09:35:57.637423 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-37a8ea87-c7ef-4fd2-8eba-b2be87c9f911 tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:35:57.638786 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-37a8ea87-c7ef-4fd2-8eba-b2be87c9f911 tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] [instance: b50feb40-c691-4724-8570-f5873bdc5d1e] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:35:57.670520 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-37a8ea87-c7ef-4fd2-8eba-b2be87c9f911 tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:35:57.672089 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-37a8ea87-c7ef-4fd2-8eba-b2be87c9f911 tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:35:57.677629 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-37a8ea87-c7ef-4fd2-8eba-b2be87c9f911 tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:35:57.685351 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-37a8ea87-c7ef-4fd2-8eba-b2be87c9f911 tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:35:57.870135 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-37a8ea87-c7ef-4fd2-8eba-b2be87c9f911 tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b547a45bb54a8f94e9e5f5aeba7520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a31f7136c241578473d4d323722c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:35:57.888154 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-37a8ea87-c7ef-4fd2-8eba-b2be87c9f911 tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] 10.222.0.45 "GET /compute/v2.1/servers/b50feb40-c691-4724-8570-f5873bdc5d1e" status: 200 len: 1211 microversion: 2.1 time: 0.264457 Jan 21 09:35:57.898423 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 11/22] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:35:57 2022] GET /compute/v2.1/servers/b50feb40-c691-4724-8570-f5873bdc5d1e => generated 1211 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 09:35:57.979505 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-7a6b8a78-bf99-4285-bd42-d4709edfbd49 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:35:57.980449 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-7a6b8a78-bf99-4285-bd42-d4709edfbd49 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] [instance: 06ae865a-6ba5-4198-be6d-e6056e645411] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:35:57.992650 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-7a6b8a78-bf99-4285-bd42-d4709edfbd49 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:35:57.998573 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-7a6b8a78-bf99-4285-bd42-d4709edfbd49 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:35:58.000886 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-7a6b8a78-bf99-4285-bd42-d4709edfbd49 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:35:58.001554 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-7a6b8a78-bf99-4285-bd42-d4709edfbd49 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:35:58.030468 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-3108f4cc-ea76-4822-8b8c-14b60af90e04 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:35:58.031419 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-3108f4cc-ea76-4822-8b8c-14b60af90e04 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] [instance: 370b78d2-d154-4c93-b8ef-3723bd26c3d4] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:35:58.048801 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-3108f4cc-ea76-4822-8b8c-14b60af90e04 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:35:58.050959 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-3108f4cc-ea76-4822-8b8c-14b60af90e04 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:35:58.052163 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-3108f4cc-ea76-4822-8b8c-14b60af90e04 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:35:58.055046 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-3108f4cc-ea76-4822-8b8c-14b60af90e04 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:35:58.313753 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-7a6b8a78-bf99-4285-bd42-d4709edfbd49 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db87258db1424ce7a8399fdd05efe3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89d1b21ad8471a8a9a82adac2594c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:35:58.325638 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-7a6b8a78-bf99-4285-bd42-d4709edfbd49 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] 10.222.0.45 "GET /compute/v2.1/servers/06ae865a-6ba5-4198-be6d-e6056e645411" status: 200 len: 1226 microversion: 2.1 time: 0.351769 Jan 21 09:35:58.326236 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 12/23] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:35:57 2022] GET /compute/v2.1/servers/06ae865a-6ba5-4198-be6d-e6056e645411 => generated 1226 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:35:58.378485 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-3108f4cc-ea76-4822-8b8c-14b60af90e04 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7b2c14d9444d65ab7a874e749671bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3390729231b409e9a83376b428c1a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:35:58.385499 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-3108f4cc-ea76-4822-8b8c-14b60af90e04 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] 10.222.0.45 "GET /compute/v2.1/servers/370b78d2-d154-4c93-b8ef-3723bd26c3d4" status: 200 len: 1213 microversion: 2.1 time: 0.360287 Jan 21 09:35:58.386088 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 12/24] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:35:58 2022] GET /compute/v2.1/servers/370b78d2-d154-4c93-b8ef-3723bd26c3d4 => generated 1213 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 09:35:58.907445 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-3455244a-82ba-49cf-ad0a-96f94d4c85ec tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:35:58.908781 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-3455244a-82ba-49cf-ad0a-96f94d4c85ec tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] [instance: b50feb40-c691-4724-8570-f5873bdc5d1e] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:35:58.921459 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-3455244a-82ba-49cf-ad0a-96f94d4c85ec tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:35:58.922202 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-3455244a-82ba-49cf-ad0a-96f94d4c85ec tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:35:58.928434 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-3455244a-82ba-49cf-ad0a-96f94d4c85ec tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:35:58.930149 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-3455244a-82ba-49cf-ad0a-96f94d4c85ec tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:35:59.045307 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-3455244a-82ba-49cf-ad0a-96f94d4c85ec tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b547a45bb54a8f94e9e5f5aeba7520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a31f7136c241578473d4d323722c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:35:59.063931 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-3455244a-82ba-49cf-ad0a-96f94d4c85ec tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] 10.222.0.45 "GET /compute/v2.1/servers/b50feb40-c691-4724-8570-f5873bdc5d1e" status: 200 len: 1267 microversion: 2.1 time: 0.161408 Jan 21 09:35:59.082591 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 13/25] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:35:58 2022] GET /compute/v2.1/servers/b50feb40-c691-4724-8570-f5873bdc5d1e => generated 1267 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 09:35:59.303770 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-881a1592-b8f2-4124-abc7-a734664b9430 tempest-VolumesTestJSON-1470128856 tempest-VolumesTestJSON-1470128856-project] Calling method '.version_select at 0x7fb6c809fc10>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:35:59.349615 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-f78b57a8-4a83-433a-a942-6549fc476770 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:35:59.350437 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-f78b57a8-4a83-433a-a942-6549fc476770 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] [instance: 06ae865a-6ba5-4198-be6d-e6056e645411] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:35:59.364315 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-f78b57a8-4a83-433a-a942-6549fc476770 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:35:59.366230 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-f78b57a8-4a83-433a-a942-6549fc476770 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:35:59.367376 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-f78b57a8-4a83-433a-a942-6549fc476770 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:35:59.368026 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-f78b57a8-4a83-433a-a942-6549fc476770 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:35:59.438668 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-881a1592-b8f2-4124-abc7-a734664b9430 tempest-VolumesTestJSON-1470128856 tempest-VolumesTestJSON-1470128856-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/55c7f609-f02b-4037-932d-cc5fad427535" status: 200 len: 350 microversion: 2.1 time: 0.138170 Jan 21 09:35:59.441421 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 13/26] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Jan 21 09:35:59 2022] GET /compute/v2.1/os-volumes/55c7f609-f02b-4037-932d-cc5fad427535 => generated 350 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 09:35:59.461631 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-4d1aa1ce-90ca-4985-ad38-21042ba7d42b tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:35:59.462627 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-4d1aa1ce-90ca-4985-ad38-21042ba7d42b tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] [instance: 370b78d2-d154-4c93-b8ef-3723bd26c3d4] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:35:59.477931 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-4d1aa1ce-90ca-4985-ad38-21042ba7d42b tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:35:59.479194 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-4d1aa1ce-90ca-4985-ad38-21042ba7d42b tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:35:59.483142 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-4d1aa1ce-90ca-4985-ad38-21042ba7d42b tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:35:59.484481 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-4d1aa1ce-90ca-4985-ad38-21042ba7d42b tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:35:59.691321 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-f78b57a8-4a83-433a-a942-6549fc476770 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db87258db1424ce7a8399fdd05efe3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89d1b21ad8471a8a9a82adac2594c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:35:59.737544 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-f78b57a8-4a83-433a-a942-6549fc476770 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] 10.222.0.45 "GET /compute/v2.1/servers/06ae865a-6ba5-4198-be6d-e6056e645411" status: 200 len: 1274 microversion: 2.1 time: 0.393092 Jan 21 09:35:59.743477 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-4d1aa1ce-90ca-4985-ad38-21042ba7d42b tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7b2c14d9444d65ab7a874e749671bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3390729231b409e9a83376b428c1a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:35:59.755576 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 14/27] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:35:59 2022] GET /compute/v2.1/servers/06ae865a-6ba5-4198-be6d-e6056e645411 => generated 1274 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:35:59.763451 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-4d1aa1ce-90ca-4985-ad38-21042ba7d42b tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] 10.222.0.45 "GET /compute/v2.1/servers/370b78d2-d154-4c93-b8ef-3723bd26c3d4" status: 200 len: 1269 microversion: 2.1 time: 0.308273 Jan 21 09:35:59.765981 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 14/28] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:35:59 2022] GET /compute/v2.1/servers/370b78d2-d154-4c93-b8ef-3723bd26c3d4 => generated 1269 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:35:59.768493 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-48c69ee0-1e2d-4db7-954c-4e8e286836b6 tempest-VolumesTestJSON-1470128856 tempest-VolumesTestJSON-1470128856-project] Calling method '.version_select at 0x7fb6c2fc5ee0>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:35:59.969118 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-23a464da-a2be-44ba-b12c-e72fb333bbe5 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-2042140638", "imageRef": "813e53ee-82e7-4a13-9f63-a8be7b1089f1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "647e31d1-4208-41da-8947-db9d9292bd9e"}], "security_groups": [{"name": "tempest-securitygroup--439146817"}], "key_name": "tempest-keypair-367654863", "user_data": "}} {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:35:59.973306 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-48c69ee0-1e2d-4db7-954c-4e8e286836b6 tempest-VolumesTestJSON-1470128856 tempest-VolumesTestJSON-1470128856-project] 10.222.0.45 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.216316 Jan 21 09:35:59.984287 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 15/29] 10.222.0.45 () {58 vars in 1133 bytes} [Fri Jan 21 09:35:59 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:35:59.990379 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-434b8b9b-9d11-40a8-b9e4-4c3bb3426a29 tempest-VolumesTestJSON-1470128856 tempest-VolumesTestJSON-1470128856-project] Calling method '.version_select at 0x7fb6c80364c0>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:36:00.193661 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-434b8b9b-9d11-40a8-b9e4-4c3bb3426a29 tempest-VolumesTestJSON-1470128856 tempest-VolumesTestJSON-1470128856-project] 10.222.0.45 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.208168 Jan 21 09:36:00.194300 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 16/30] 10.222.0.45 () {58 vars in 1148 bytes} [Fri Jan 21 09:35:59 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 09:36:00.205838 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-5219ac9b-b9bd-4b2c-ba18-ef6faae29a83 tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:36:00.206465 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-5219ac9b-b9bd-4b2c-ba18-ef6faae29a83 tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] [instance: b50feb40-c691-4724-8570-f5873bdc5d1e] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:36:00.268877 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-5219ac9b-b9bd-4b2c-ba18-ef6faae29a83 tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:00.271466 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-5219ac9b-b9bd-4b2c-ba18-ef6faae29a83 tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:00.274166 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-5219ac9b-b9bd-4b2c-ba18-ef6faae29a83 tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:00.274831 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-5219ac9b-b9bd-4b2c-ba18-ef6faae29a83 tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:00.489307 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-5219ac9b-b9bd-4b2c-ba18-ef6faae29a83 tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b547a45bb54a8f94e9e5f5aeba7520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a31f7136c241578473d4d323722c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:36:00.510556 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-5219ac9b-b9bd-4b2c-ba18-ef6faae29a83 tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] 10.222.0.45 "GET /compute/v2.1/servers/b50feb40-c691-4724-8570-f5873bdc5d1e" status: 200 len: 1273 microversion: 2.1 time: 0.308034 Jan 21 09:36:00.517631 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 17/31] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:36:00 2022] GET /compute/v2.1/servers/b50feb40-c691-4724-8570-f5873bdc5d1e => generated 1273 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:36:00.537114 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-6b1bd555-fc5f-4128-a9a1-d6288d1b0983 tempest-VolumesTestJSON-1470128856 tempest-VolumesTestJSON-1470128856-project] Calling method '.version_select at 0x7fb6c2fc5f70>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:36:00.727875 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.network.neutron [None req-23a464da-a2be-44ba-b12c-e72fb333bbe5 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] validate_networks() for [('647e31d1-4208-41da-8947-db9d9292bd9e', None, None, None, None, None)] {{(pid=123386) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 21 09:36:00.841121 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-6b1bd555-fc5f-4128-a9a1-d6288d1b0983 tempest-VolumesTestJSON-1470128856 tempest-VolumesTestJSON-1470128856-project] 10.222.0.45 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.319989 Jan 21 09:36:00.843771 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 18/32] 10.222.0.45 () {58 vars in 1133 bytes} [Fri Jan 21 09:36:00 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:36:00.854322 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-6a4dbb3a-f39e-4299-b465-c1a7231d14ad tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:36:00.855232 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-6a4dbb3a-f39e-4299-b465-c1a7231d14ad tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] [instance: 06ae865a-6ba5-4198-be6d-e6056e645411] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:36:00.866801 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-6a4dbb3a-f39e-4299-b465-c1a7231d14ad tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:00.867595 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-6a4dbb3a-f39e-4299-b465-c1a7231d14ad tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:00.868996 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-6a4dbb3a-f39e-4299-b465-c1a7231d14ad tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:00.869685 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-6a4dbb3a-f39e-4299-b465-c1a7231d14ad tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:01.022953 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-6a4dbb3a-f39e-4299-b465-c1a7231d14ad tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db87258db1424ce7a8399fdd05efe3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89d1b21ad8471a8a9a82adac2594c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:36:01.031328 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-6a4dbb3a-f39e-4299-b465-c1a7231d14ad tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] 10.222.0.45 "GET /compute/v2.1/servers/06ae865a-6ba5-4198-be6d-e6056e645411" status: 200 len: 1280 microversion: 2.1 time: 0.187820 Jan 21 09:36:01.039047 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 19/33] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:36:00 2022] GET /compute/v2.1/servers/06ae865a-6ba5-4198-be6d-e6056e645411 => generated 1280 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:36:01.039047 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-56b93bed-1e27-4750-b0c1-5c6c52cc34d5 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:36:01.039047 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-56b93bed-1e27-4750-b0c1-5c6c52cc34d5 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] [instance: 370b78d2-d154-4c93-b8ef-3723bd26c3d4] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:36:01.057611 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-56b93bed-1e27-4750-b0c1-5c6c52cc34d5 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:01.058064 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-56b93bed-1e27-4750-b0c1-5c6c52cc34d5 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:01.063363 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-56b93bed-1e27-4750-b0c1-5c6c52cc34d5 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:01.063821 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-56b93bed-1e27-4750-b0c1-5c6c52cc34d5 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:01.192383 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-56b93bed-1e27-4750-b0c1-5c6c52cc34d5 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7b2c14d9444d65ab7a874e749671bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3390729231b409e9a83376b428c1a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:36:01.205723 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-56b93bed-1e27-4750-b0c1-5c6c52cc34d5 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] 10.222.0.45 "GET /compute/v2.1/servers/370b78d2-d154-4c93-b8ef-3723bd26c3d4" status: 200 len: 1275 microversion: 2.1 time: 0.172596 Jan 21 09:36:01.207043 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 20/34] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:36:01 2022] GET /compute/v2.1/servers/370b78d2-d154-4c93-b8ef-3723bd26c3d4 => generated 1275 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:36:01.219603 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-4e3d5bb3-6cc2-4391-ac7b-683f4f46e228 tempest-VolumesTestJSON-1470128856 tempest-VolumesTestJSON-1470128856-project] Calling method '.version_select at 0x7fb6c8077280>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:36:01.416195 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-4e3d5bb3-6cc2-4391-ac7b-683f4f46e228 tempest-VolumesTestJSON-1470128856 tempest-VolumesTestJSON-1470128856-project] 10.222.0.45 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.207620 Jan 21 09:36:01.416814 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 21/35] 10.222.0.45 () {58 vars in 1166 bytes} [Fri Jan 21 09:36:01 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 09:36:01.428503 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-61a18750-8ba6-494b-8780-47bb5b93f2aa tempest-VolumesTestJSON-1470128856 tempest-VolumesTestJSON-1470128856-project] Calling method '.version_select at 0x7fb6c8036af0>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:36:01.668713 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-61a18750-8ba6-494b-8780-47bb5b93f2aa tempest-VolumesTestJSON-1470128856 tempest-VolumesTestJSON-1470128856-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.243773 Jan 21 09:36:01.670029 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 22/36] 10.222.0.45 () {58 vars in 1169 bytes} [Fri Jan 21 09:36:01 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 09:36:01.682458 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-a0344346-8fb8-41ba-9b54-75d378d56b77 tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:36:01.683111 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-a0344346-8fb8-41ba-9b54-75d378d56b77 tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] [instance: b50feb40-c691-4724-8570-f5873bdc5d1e] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:36:01.705010 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-a0344346-8fb8-41ba-9b54-75d378d56b77 tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:01.707195 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-a0344346-8fb8-41ba-9b54-75d378d56b77 tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:01.712204 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-a0344346-8fb8-41ba-9b54-75d378d56b77 tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:01.714450 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-a0344346-8fb8-41ba-9b54-75d378d56b77 tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:01.836271 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-a0344346-8fb8-41ba-9b54-75d378d56b77 tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b547a45bb54a8f94e9e5f5aeba7520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a31f7136c241578473d4d323722c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:36:01.859425 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-a0344346-8fb8-41ba-9b54-75d378d56b77 tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] 10.222.0.45 "GET /compute/v2.1/servers/b50feb40-c691-4724-8570-f5873bdc5d1e" status: 200 len: 1273 microversion: 2.1 time: 0.182930 Jan 21 09:36:01.862346 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 23/37] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:36:01 2022] GET /compute/v2.1/servers/b50feb40-c691-4724-8570-f5873bdc5d1e => generated 1273 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:36:01.872491 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-e1c308ef-5011-477c-a9e5-7ce319b98def tempest-VolumesTestJSON-1470128856 tempest-VolumesTestJSON-1470128856-project] Calling method '.version_select at 0x7fb6c80ae700>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:36:01.968423 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.virt.hardware [None req-23a464da-a2be-44ba-b12c-e72fb333bbe5 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Flavor limits 0:0:0 {{(pid=123386) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 21 09:36:01.968961 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.virt.hardware [None req-23a464da-a2be-44ba-b12c-e72fb333bbe5 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Image limits 0:0:0 {{(pid=123386) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 21 09:36:01.969688 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.virt.hardware [None req-23a464da-a2be-44ba-b12c-e72fb333bbe5 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Flavor pref 0:0:0 {{(pid=123386) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 21 09:36:01.970478 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.virt.hardware [None req-23a464da-a2be-44ba-b12c-e72fb333bbe5 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Image pref 0:0:0 {{(pid=123386) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 21 09:36:01.971113 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.virt.hardware [None req-23a464da-a2be-44ba-b12c-e72fb333bbe5 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123386) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 21 09:36:02.003043 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-23a464da-a2be-44ba-b12c-e72fb333bbe5 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:02.003845 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-23a464da-a2be-44ba-b12c-e72fb333bbe5 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:02.004829 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-23a464da-a2be-44ba-b12c-e72fb333bbe5 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:02.005427 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-23a464da-a2be-44ba-b12c-e72fb333bbe5 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:02.105183 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.quota [None req-23a464da-a2be-44ba-b12c-e72fb333bbe5 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Getting quotas for project 93281ac9cb504124a055279296f2262f. Resources: {'cores', 'instances', 'ram'} {{(pid=123386) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 21 09:36:02.131423 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.quota [None req-23a464da-a2be-44ba-b12c-e72fb333bbe5 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Getting quotas for user c190858354e14533a06a1fac88f2cfd3 and project 93281ac9cb504124a055279296f2262f. Resources: {'cores', 'instances', 'ram'} {{(pid=123386) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 21 09:36:02.165194 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-e1c308ef-5011-477c-a9e5-7ce319b98def tempest-VolumesTestJSON-1470128856 tempest-VolumesTestJSON-1470128856-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.300488 Jan 21 09:36:02.166330 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 24/38] 10.222.0.45 () {58 vars in 1154 bytes} [Fri Jan 21 09:36:01 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:36:02.172538 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-5f5cd4d3-7dbe-457e-8320-12f889d288e0 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:36:02.173567 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-5f5cd4d3-7dbe-457e-8320-12f889d288e0 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] [instance: 06ae865a-6ba5-4198-be6d-e6056e645411] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:36:02.180653 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-5f5cd4d3-7dbe-457e-8320-12f889d288e0 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:02.181287 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-5f5cd4d3-7dbe-457e-8320-12f889d288e0 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:02.182492 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-5f5cd4d3-7dbe-457e-8320-12f889d288e0 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:02.183405 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-5f5cd4d3-7dbe-457e-8320-12f889d288e0 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:02.190171 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-23a464da-a2be-44ba-b12c-e72fb333bbe5 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Going to run 1 instances... {{(pid=123386) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 21 09:36:02.192870 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-23a464da-a2be-44ba-b12c-e72fb333bbe5 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] [instance: 59ad64a5-af93-44ef-8031-fd2f2d18a901] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='813e53ee-82e7-4a13-9f63-a8be7b1089f1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123386) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 21 09:36:02.406917 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-5f5cd4d3-7dbe-457e-8320-12f889d288e0 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db87258db1424ce7a8399fdd05efe3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89d1b21ad8471a8a9a82adac2594c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:36:02.421697 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-5f5cd4d3-7dbe-457e-8320-12f889d288e0 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] 10.222.0.45 "GET /compute/v2.1/servers/06ae865a-6ba5-4198-be6d-e6056e645411" status: 200 len: 1280 microversion: 2.1 time: 0.253860 Jan 21 09:36:02.448756 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 25/39] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:36:02 2022] GET /compute/v2.1/servers/06ae865a-6ba5-4198-be6d-e6056e645411 => generated 1280 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:36:02.494828 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-23a464da-a2be-44ba-b12c-e72fb333bbe5 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 2.511747 Jan 21 09:36:02.495022 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-03b4865c-d97f-4bee-b518-365ce27fb2c1 tempest-VolumesTestJSON-1470128856 tempest-VolumesTestJSON-1470128856-project] Calling method '.version_select at 0x7fb6c8077e50>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:36:02.501557 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 15/40] 10.222.0.45 () {62 vars in 1187 bytes} [Fri Jan 21 09:35:59 2022] POST /compute/v2.1/servers => generated 401 bytes in 2537 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Jan 21 09:36:02.541970 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-3528da6f-1d2b-4be1-a060-1ea7a4fe483d tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:36:02.546258 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-3528da6f-1d2b-4be1-a060-1ea7a4fe483d tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] [instance: 370b78d2-d154-4c93-b8ef-3723bd26c3d4] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:36:02.558150 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-3528da6f-1d2b-4be1-a060-1ea7a4fe483d tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:02.558615 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-3528da6f-1d2b-4be1-a060-1ea7a4fe483d tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:02.559834 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-3528da6f-1d2b-4be1-a060-1ea7a4fe483d tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:02.561083 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-3528da6f-1d2b-4be1-a060-1ea7a4fe483d tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:02.754582 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-3528da6f-1d2b-4be1-a060-1ea7a4fe483d tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7b2c14d9444d65ab7a874e749671bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3390729231b409e9a83376b428c1a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:36:02.758407 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-3528da6f-1d2b-4be1-a060-1ea7a4fe483d tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] 10.222.0.45 "GET /compute/v2.1/servers/370b78d2-d154-4c93-b8ef-3723bd26c3d4" status: 200 len: 1275 microversion: 2.1 time: 0.254066 Jan 21 09:36:02.759188 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 16/41] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:36:02 2022] GET /compute/v2.1/servers/370b78d2-d154-4c93-b8ef-3723bd26c3d4 => generated 1275 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:36:02.767613 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-38b9911a-f479-4ef2-b356-b93a9f3f30ba tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:36:02.777020 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-38b9911a-f479-4ef2-b356-b93a9f3f30ba tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] [instance: 59ad64a5-af93-44ef-8031-fd2f2d18a901] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:36:02.840524 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-03b4865c-d97f-4bee-b518-365ce27fb2c1 tempest-VolumesTestJSON-1470128856 tempest-VolumesTestJSON-1470128856-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.384196 Jan 21 09:36:02.848058 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 26/42] 10.222.0.45 () {58 vars in 1187 bytes} [Fri Jan 21 09:36:02 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 09:36:02.858719 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-0a25b48f-f4d5-4263-9d7d-50d20052e3dd tempest-VolumesTestJSON-1470128856 tempest-VolumesTestJSON-1470128856-project] Calling method '.version_select at 0x7fb6c2fe7ee0>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:36:02.973109 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-38b9911a-f479-4ef2-b356-b93a9f3f30ba tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:36:02.986748 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-38b9911a-f479-4ef2-b356-b93a9f3f30ba tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:36:02.988557 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-38b9911a-f479-4ef2-b356-b93a9f3f30ba tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:36:02.989718 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-38b9911a-f479-4ef2-b356-b93a9f3f30ba tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "GET /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901" status: 200 len: 1281 microversion: 2.20 time: 0.229244 Jan 21 09:36:02.990290 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 17/43] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jan 21 09:36:02 2022] GET /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901 => generated 1281 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 21 09:36:03.021170 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-6b8076c0-9221-40b3-b0d8-e90a7258d32d tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:36:03.022026 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-6b8076c0-9221-40b3-b0d8-e90a7258d32d tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] [instance: b50feb40-c691-4724-8570-f5873bdc5d1e] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:36:03.034701 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-6b8076c0-9221-40b3-b0d8-e90a7258d32d tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:03.035790 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-6b8076c0-9221-40b3-b0d8-e90a7258d32d tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:03.036649 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-6b8076c0-9221-40b3-b0d8-e90a7258d32d tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:03.037064 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-6b8076c0-9221-40b3-b0d8-e90a7258d32d tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:03.086567 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-0a25b48f-f4d5-4263-9d7d-50d20052e3dd tempest-VolumesTestJSON-1470128856 tempest-VolumesTestJSON-1470128856-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.234343 Jan 21 09:36:03.088078 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 27/44] 10.222.0.45 () {58 vars in 1154 bytes} [Fri Jan 21 09:36:02 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:36:03.129360 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-6b8076c0-9221-40b3-b0d8-e90a7258d32d tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b547a45bb54a8f94e9e5f5aeba7520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a31f7136c241578473d4d323722c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:36:03.146065 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-6b8076c0-9221-40b3-b0d8-e90a7258d32d tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] 10.222.0.45 "GET /compute/v2.1/servers/b50feb40-c691-4724-8570-f5873bdc5d1e" status: 200 len: 1273 microversion: 2.1 time: 0.154460 Jan 21 09:36:03.153514 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 18/45] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:36:02 2022] GET /compute/v2.1/servers/b50feb40-c691-4724-8570-f5873bdc5d1e => generated 1273 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:36:03.525247 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-f8b0dc23-62e9-41c7-bc2f-4f92ac7b9547 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:36:03.525247 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-f8b0dc23-62e9-41c7-bc2f-4f92ac7b9547 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] [instance: 06ae865a-6ba5-4198-be6d-e6056e645411] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:36:03.525247 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-f8b0dc23-62e9-41c7-bc2f-4f92ac7b9547 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:03.525247 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-f8b0dc23-62e9-41c7-bc2f-4f92ac7b9547 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:03.528057 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-f8b0dc23-62e9-41c7-bc2f-4f92ac7b9547 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:03.528057 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-f8b0dc23-62e9-41c7-bc2f-4f92ac7b9547 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:03.556487 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-f8b0dc23-62e9-41c7-bc2f-4f92ac7b9547 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db87258db1424ce7a8399fdd05efe3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89d1b21ad8471a8a9a82adac2594c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:36:03.563722 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-f8b0dc23-62e9-41c7-bc2f-4f92ac7b9547 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] 10.222.0.45 "GET /compute/v2.1/servers/06ae865a-6ba5-4198-be6d-e6056e645411" status: 200 len: 1280 microversion: 2.1 time: 0.095056 Jan 21 09:36:03.570445 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 28/46] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:36:03 2022] GET /compute/v2.1/servers/06ae865a-6ba5-4198-be6d-e6056e645411 => generated 1280 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:36:03.777745 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-09b373dd-dbfa-482f-8b04-21c382ed2be2 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:36:03.778466 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-09b373dd-dbfa-482f-8b04-21c382ed2be2 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] [instance: 370b78d2-d154-4c93-b8ef-3723bd26c3d4] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:36:03.785977 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-09b373dd-dbfa-482f-8b04-21c382ed2be2 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:03.786564 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-09b373dd-dbfa-482f-8b04-21c382ed2be2 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:03.787557 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-09b373dd-dbfa-482f-8b04-21c382ed2be2 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:03.788693 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-09b373dd-dbfa-482f-8b04-21c382ed2be2 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:04.023947 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-755502dd-0387-4c3e-bcfc-605c80bbecdf tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:36:04.024463 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-755502dd-0387-4c3e-bcfc-605c80bbecdf tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] [instance: 59ad64a5-af93-44ef-8031-fd2f2d18a901] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:36:04.054471 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-09b373dd-dbfa-482f-8b04-21c382ed2be2 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7b2c14d9444d65ab7a874e749671bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3390729231b409e9a83376b428c1a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:36:04.063843 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-09b373dd-dbfa-482f-8b04-21c382ed2be2 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] 10.222.0.45 "GET /compute/v2.1/servers/370b78d2-d154-4c93-b8ef-3723bd26c3d4" status: 200 len: 1317 microversion: 2.1 time: 0.291359 Jan 21 09:36:04.075028 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 19/47] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:36:03 2022] GET /compute/v2.1/servers/370b78d2-d154-4c93-b8ef-3723bd26c3d4 => generated 1317 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 09:36:04.118329 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-755502dd-0387-4c3e-bcfc-605c80bbecdf tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:36:04.129107 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-755502dd-0387-4c3e-bcfc-605c80bbecdf tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:36:04.131488 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-755502dd-0387-4c3e-bcfc-605c80bbecdf tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:36:04.134464 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-755502dd-0387-4c3e-bcfc-605c80bbecdf tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "GET /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901" status: 200 len: 1281 microversion: 2.20 time: 0.129712 Jan 21 09:36:04.146007 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 29/48] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jan 21 09:36:04 2022] GET /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901 => generated 1281 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 21 09:36:04.171686 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-b0b8d93d-3a24-4247-9473-85002fe4318b tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:36:04.173747 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-b0b8d93d-3a24-4247-9473-85002fe4318b tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] [instance: b50feb40-c691-4724-8570-f5873bdc5d1e] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:36:04.182839 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-b0b8d93d-3a24-4247-9473-85002fe4318b tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:04.182839 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-b0b8d93d-3a24-4247-9473-85002fe4318b tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:04.183946 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-b0b8d93d-3a24-4247-9473-85002fe4318b tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:04.184738 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-b0b8d93d-3a24-4247-9473-85002fe4318b tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:04.403391 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-b0b8d93d-3a24-4247-9473-85002fe4318b tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b547a45bb54a8f94e9e5f5aeba7520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a31f7136c241578473d4d323722c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:36:04.410703 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-b0b8d93d-3a24-4247-9473-85002fe4318b tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] 10.222.0.45 "GET /compute/v2.1/servers/b50feb40-c691-4724-8570-f5873bdc5d1e" status: 200 len: 1315 microversion: 2.1 time: 0.245114 Jan 21 09:36:04.424549 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 20/49] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:36:04 2022] GET /compute/v2.1/servers/b50feb40-c691-4724-8570-f5873bdc5d1e => generated 1315 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 09:36:04.581851 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-8b0d259f-f8cd-4ea1-b99c-e91529433af2 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:36:04.582522 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-8b0d259f-f8cd-4ea1-b99c-e91529433af2 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] [instance: 06ae865a-6ba5-4198-be6d-e6056e645411] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:36:04.589209 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-8b0d259f-f8cd-4ea1-b99c-e91529433af2 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:04.589685 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-8b0d259f-f8cd-4ea1-b99c-e91529433af2 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:04.590528 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-8b0d259f-f8cd-4ea1-b99c-e91529433af2 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:04.590963 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-8b0d259f-f8cd-4ea1-b99c-e91529433af2 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:04.840554 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-8b0d259f-f8cd-4ea1-b99c-e91529433af2 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db87258db1424ce7a8399fdd05efe3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89d1b21ad8471a8a9a82adac2594c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:36:04.850400 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-8b0d259f-f8cd-4ea1-b99c-e91529433af2 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] 10.222.0.45 "GET /compute/v2.1/servers/06ae865a-6ba5-4198-be6d-e6056e645411" status: 200 len: 1322 microversion: 2.1 time: 0.272106 Jan 21 09:36:04.860957 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 30/50] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:36:04 2022] GET /compute/v2.1/servers/06ae865a-6ba5-4198-be6d-e6056e645411 => generated 1322 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:36:05.084238 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-9da124f1-880b-4676-b49e-8bae370c6244 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:36:05.085101 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-9da124f1-880b-4676-b49e-8bae370c6244 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] [instance: 370b78d2-d154-4c93-b8ef-3723bd26c3d4] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:36:05.091510 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-9da124f1-880b-4676-b49e-8bae370c6244 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:05.095128 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-9da124f1-880b-4676-b49e-8bae370c6244 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:05.095128 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-9da124f1-880b-4676-b49e-8bae370c6244 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:05.095128 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-9da124f1-880b-4676-b49e-8bae370c6244 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:05.159341 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-ae4c2ee1-aae7-4e0d-9831-be106aa64943 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:36:05.160199 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-ae4c2ee1-aae7-4e0d-9831-be106aa64943 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] [instance: 59ad64a5-af93-44ef-8031-fd2f2d18a901] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:36:05.170455 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-ae4c2ee1-aae7-4e0d-9831-be106aa64943 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:05.171460 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-ae4c2ee1-aae7-4e0d-9831-be106aa64943 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:05.172342 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-ae4c2ee1-aae7-4e0d-9831-be106aa64943 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:05.172889 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-ae4c2ee1-aae7-4e0d-9831-be106aa64943 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:05.250116 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-ae4c2ee1-aae7-4e0d-9831-be106aa64943 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:36:05.253131 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-ae4c2ee1-aae7-4e0d-9831-be106aa64943 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:36:05.254491 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-ae4c2ee1-aae7-4e0d-9831-be106aa64943 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:36:05.255627 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-ae4c2ee1-aae7-4e0d-9831-be106aa64943 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "GET /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901" status: 200 len: 1285 microversion: 2.20 time: 0.106842 Jan 21 09:36:05.256437 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 31/51] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jan 21 09:36:05 2022] GET /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901 => generated 1285 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 21 09:36:05.284951 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-9da124f1-880b-4676-b49e-8bae370c6244 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7b2c14d9444d65ab7a874e749671bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3390729231b409e9a83376b428c1a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:36:05.296398 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-9da124f1-880b-4676-b49e-8bae370c6244 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] 10.222.0.45 "GET /compute/v2.1/servers/370b78d2-d154-4c93-b8ef-3723bd26c3d4" status: 200 len: 1317 microversion: 2.1 time: 0.215861 Jan 21 09:36:05.297621 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 21/52] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:36:05 2022] GET /compute/v2.1/servers/370b78d2-d154-4c93-b8ef-3723bd26c3d4 => generated 1317 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 09:36:05.434596 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-f8ed0fc9-6c5e-47be-88f7-97e24dafe181 tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:36:05.435522 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-f8ed0fc9-6c5e-47be-88f7-97e24dafe181 tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] [instance: b50feb40-c691-4724-8570-f5873bdc5d1e] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:36:05.443642 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-f8ed0fc9-6c5e-47be-88f7-97e24dafe181 tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:05.444562 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-f8ed0fc9-6c5e-47be-88f7-97e24dafe181 tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:05.445920 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-f8ed0fc9-6c5e-47be-88f7-97e24dafe181 tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:05.446616 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-f8ed0fc9-6c5e-47be-88f7-97e24dafe181 tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:05.674499 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-f8ed0fc9-6c5e-47be-88f7-97e24dafe181 tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b547a45bb54a8f94e9e5f5aeba7520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a31f7136c241578473d4d323722c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:36:05.684339 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-f8ed0fc9-6c5e-47be-88f7-97e24dafe181 tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] 10.222.0.45 "GET /compute/v2.1/servers/b50feb40-c691-4724-8570-f5873bdc5d1e" status: 200 len: 1315 microversion: 2.1 time: 0.253331 Jan 21 09:36:05.695824 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 32/53] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:36:05 2022] GET /compute/v2.1/servers/b50feb40-c691-4724-8570-f5873bdc5d1e => generated 1315 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:36:05.867249 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-fcd9831e-f9cc-40c9-aac5-f59a4c89a7be tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:36:05.868263 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-fcd9831e-f9cc-40c9-aac5-f59a4c89a7be tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] [instance: 06ae865a-6ba5-4198-be6d-e6056e645411] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:36:05.874415 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-fcd9831e-f9cc-40c9-aac5-f59a4c89a7be tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:05.875154 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-fcd9831e-f9cc-40c9-aac5-f59a4c89a7be tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:05.876108 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-fcd9831e-f9cc-40c9-aac5-f59a4c89a7be tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:05.876733 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-fcd9831e-f9cc-40c9-aac5-f59a4c89a7be tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:06.079832 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-fcd9831e-f9cc-40c9-aac5-f59a4c89a7be tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db87258db1424ce7a8399fdd05efe3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89d1b21ad8471a8a9a82adac2594c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:36:06.091022 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-fcd9831e-f9cc-40c9-aac5-f59a4c89a7be tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] 10.222.0.45 "GET /compute/v2.1/servers/06ae865a-6ba5-4198-be6d-e6056e645411" status: 200 len: 1322 microversion: 2.1 time: 0.227716 Jan 21 09:36:06.101247 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 22/54] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:36:05 2022] GET /compute/v2.1/servers/06ae865a-6ba5-4198-be6d-e6056e645411 => generated 1322 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:36:06.275362 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-9ca2e4f6-8fee-4d66-be31-33089780574e tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:36:06.276344 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-9ca2e4f6-8fee-4d66-be31-33089780574e tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] [instance: 59ad64a5-af93-44ef-8031-fd2f2d18a901] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:36:06.282831 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-9ca2e4f6-8fee-4d66-be31-33089780574e tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:06.283543 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-9ca2e4f6-8fee-4d66-be31-33089780574e tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:06.284347 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-9ca2e4f6-8fee-4d66-be31-33089780574e tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:06.285074 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-9ca2e4f6-8fee-4d66-be31-33089780574e tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:06.327270 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-1723cb30-266f-467e-b040-3e311f472df7 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:36:06.331201 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-1723cb30-266f-467e-b040-3e311f472df7 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] [instance: 370b78d2-d154-4c93-b8ef-3723bd26c3d4] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:36:06.338116 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-1723cb30-266f-467e-b040-3e311f472df7 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:06.339165 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-1723cb30-266f-467e-b040-3e311f472df7 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:06.340200 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-1723cb30-266f-467e-b040-3e311f472df7 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:06.341006 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-1723cb30-266f-467e-b040-3e311f472df7 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:06.355759 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-9ca2e4f6-8fee-4d66-be31-33089780574e tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:36:06.365384 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-9ca2e4f6-8fee-4d66-be31-33089780574e tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:36:06.367739 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-9ca2e4f6-8fee-4d66-be31-33089780574e tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:36:06.369274 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-9ca2e4f6-8fee-4d66-be31-33089780574e tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "GET /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901" status: 200 len: 1285 microversion: 2.20 time: 0.098479 Jan 21 09:36:06.369842 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 33/55] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jan 21 09:36:06 2022] GET /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901 => generated 1285 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 21 09:36:06.679213 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-1723cb30-266f-467e-b040-3e311f472df7 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7b2c14d9444d65ab7a874e749671bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3390729231b409e9a83376b428c1a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:36:06.699505 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-1723cb30-266f-467e-b040-3e311f472df7 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] 10.222.0.45 "GET /compute/v2.1/servers/370b78d2-d154-4c93-b8ef-3723bd26c3d4" status: 200 len: 1317 microversion: 2.1 time: 0.387040 Jan 21 09:36:06.703540 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 23/56] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:36:06 2022] GET /compute/v2.1/servers/370b78d2-d154-4c93-b8ef-3723bd26c3d4 => generated 1317 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:36:06.703662 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-f0a1916a-df1e-4ada-87cb-3fb48954f8e8 tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:36:06.703662 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-f0a1916a-df1e-4ada-87cb-3fb48954f8e8 tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] [instance: b50feb40-c691-4724-8570-f5873bdc5d1e] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:36:06.712219 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-f0a1916a-df1e-4ada-87cb-3fb48954f8e8 tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:06.714922 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-f0a1916a-df1e-4ada-87cb-3fb48954f8e8 tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:06.717713 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-f0a1916a-df1e-4ada-87cb-3fb48954f8e8 tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:06.719359 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-f0a1916a-df1e-4ada-87cb-3fb48954f8e8 tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:07.196269 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-f0a1916a-df1e-4ada-87cb-3fb48954f8e8 tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b547a45bb54a8f94e9e5f5aeba7520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a31f7136c241578473d4d323722c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:36:07.196269 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-f0a1916a-df1e-4ada-87cb-3fb48954f8e8 tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] 10.222.0.45 "GET /compute/v2.1/servers/b50feb40-c691-4724-8570-f5873bdc5d1e" status: 200 len: 1315 microversion: 2.1 time: 0.394991 Jan 21 09:36:07.196269 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 34/57] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:36:06 2022] GET /compute/v2.1/servers/b50feb40-c691-4724-8570-f5873bdc5d1e => generated 1315 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:36:07.197903 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-c4657b52-997a-4cb7-b129-77657ef08b2a tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:36:07.197903 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-c4657b52-997a-4cb7-b129-77657ef08b2a tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] [instance: 06ae865a-6ba5-4198-be6d-e6056e645411] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:36:07.197903 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-c4657b52-997a-4cb7-b129-77657ef08b2a tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:07.197903 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-c4657b52-997a-4cb7-b129-77657ef08b2a tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:07.199098 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-c4657b52-997a-4cb7-b129-77657ef08b2a tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:07.199098 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-c4657b52-997a-4cb7-b129-77657ef08b2a tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:07.399394 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-8e482415-961a-4039-b357-a53d5a9f23bb tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:36:07.400632 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-8e482415-961a-4039-b357-a53d5a9f23bb tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] [instance: 59ad64a5-af93-44ef-8031-fd2f2d18a901] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:36:07.434358 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-8e482415-961a-4039-b357-a53d5a9f23bb tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:07.440261 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-8e482415-961a-4039-b357-a53d5a9f23bb tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:07.440261 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-8e482415-961a-4039-b357-a53d5a9f23bb tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:07.442613 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-8e482415-961a-4039-b357-a53d5a9f23bb tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:07.781963 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-8e482415-961a-4039-b357-a53d5a9f23bb tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:36:07.792056 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-8e482415-961a-4039-b357-a53d5a9f23bb tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:36:07.800157 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-8e482415-961a-4039-b357-a53d5a9f23bb tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:36:07.801758 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-8e482415-961a-4039-b357-a53d5a9f23bb tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "GET /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901" status: 200 len: 1277 microversion: 2.20 time: 0.408163 Jan 21 09:36:07.802827 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 35/58] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jan 21 09:36:07 2022] GET /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901 => generated 1277 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 21 09:36:07.812951 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-add00a0d-4b11-4b1b-80e7-a7968c897af2 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:36:07.813885 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-add00a0d-4b11-4b1b-80e7-a7968c897af2 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] [instance: 370b78d2-d154-4c93-b8ef-3723bd26c3d4] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:36:07.832765 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-add00a0d-4b11-4b1b-80e7-a7968c897af2 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:07.833512 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-add00a0d-4b11-4b1b-80e7-a7968c897af2 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:07.834486 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-add00a0d-4b11-4b1b-80e7-a7968c897af2 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:07.835782 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-add00a0d-4b11-4b1b-80e7-a7968c897af2 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:08.105115 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-c4657b52-997a-4cb7-b129-77657ef08b2a tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db87258db1424ce7a8399fdd05efe3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89d1b21ad8471a8a9a82adac2594c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:36:08.125804 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-c4657b52-997a-4cb7-b129-77657ef08b2a tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] 10.222.0.45 "GET /compute/v2.1/servers/06ae865a-6ba5-4198-be6d-e6056e645411" status: 200 len: 1322 microversion: 2.1 time: 1.011000 Jan 21 09:36:08.130465 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 24/59] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:36:07 2022] GET /compute/v2.1/servers/06ae865a-6ba5-4198-be6d-e6056e645411 => generated 1322 bytes in 1017 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:36:08.142049 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-6fece5ba-8bc8-4e38-9152-63ab554e0ed0 tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:36:08.143105 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-6fece5ba-8bc8-4e38-9152-63ab554e0ed0 tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] [instance: b50feb40-c691-4724-8570-f5873bdc5d1e] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:36:08.151981 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-6fece5ba-8bc8-4e38-9152-63ab554e0ed0 tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:08.152721 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-6fece5ba-8bc8-4e38-9152-63ab554e0ed0 tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:08.154112 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-6fece5ba-8bc8-4e38-9152-63ab554e0ed0 tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:08.154911 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-6fece5ba-8bc8-4e38-9152-63ab554e0ed0 tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:08.435920 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-add00a0d-4b11-4b1b-80e7-a7968c897af2 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7b2c14d9444d65ab7a874e749671bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3390729231b409e9a83376b428c1a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:36:08.443761 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-add00a0d-4b11-4b1b-80e7-a7968c897af2 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] 10.222.0.45 "GET /compute/v2.1/servers/370b78d2-d154-4c93-b8ef-3723bd26c3d4" status: 200 len: 1317 microversion: 2.1 time: 0.638975 Jan 21 09:36:08.457072 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 36/60] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:36:07 2022] GET /compute/v2.1/servers/370b78d2-d154-4c93-b8ef-3723bd26c3d4 => generated 1317 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:36:08.614308 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-6fece5ba-8bc8-4e38-9152-63ab554e0ed0 tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b547a45bb54a8f94e9e5f5aeba7520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a31f7136c241578473d4d323722c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:36:08.626086 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-6fece5ba-8bc8-4e38-9152-63ab554e0ed0 tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] 10.222.0.45 "GET /compute/v2.1/servers/b50feb40-c691-4724-8570-f5873bdc5d1e" status: 200 len: 1315 microversion: 2.1 time: 0.492938 Jan 21 09:36:08.628631 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 25/61] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:36:08 2022] GET /compute/v2.1/servers/b50feb40-c691-4724-8570-f5873bdc5d1e => generated 1315 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:36:08.826408 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-3721708a-fc1b-488d-9492-31645a58a724 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:36:08.827011 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-3721708a-fc1b-488d-9492-31645a58a724 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] [instance: 59ad64a5-af93-44ef-8031-fd2f2d18a901] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:36:08.839147 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-3721708a-fc1b-488d-9492-31645a58a724 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:08.839603 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-3721708a-fc1b-488d-9492-31645a58a724 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:08.840405 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-3721708a-fc1b-488d-9492-31645a58a724 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:08.840821 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-3721708a-fc1b-488d-9492-31645a58a724 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:09.138849 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-3721708a-fc1b-488d-9492-31645a58a724 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:36:09.148462 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-ce6ff9f9-757e-435d-9948-c014881d3b22 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:36:09.149331 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-ce6ff9f9-757e-435d-9948-c014881d3b22 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] [instance: 06ae865a-6ba5-4198-be6d-e6056e645411] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:36:09.156731 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-3721708a-fc1b-488d-9492-31645a58a724 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:36:09.159727 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-3721708a-fc1b-488d-9492-31645a58a724 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:36:09.161064 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-ce6ff9f9-757e-435d-9948-c014881d3b22 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:09.165320 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-3721708a-fc1b-488d-9492-31645a58a724 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "GET /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901" status: 200 len: 1333 microversion: 2.20 time: 0.338087 Jan 21 09:36:09.165320 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 37/62] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jan 21 09:36:08 2022] GET /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901 => generated 1333 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 21 09:36:09.166273 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-ce6ff9f9-757e-435d-9948-c014881d3b22 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:09.167229 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-ce6ff9f9-757e-435d-9948-c014881d3b22 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:09.167782 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-ce6ff9f9-757e-435d-9948-c014881d3b22 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:09.464284 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-fd79d664-c884-413e-86b2-a51070966dbe tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:36:09.465180 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-fd79d664-c884-413e-86b2-a51070966dbe tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] [instance: 370b78d2-d154-4c93-b8ef-3723bd26c3d4] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:36:09.479386 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-fd79d664-c884-413e-86b2-a51070966dbe tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:09.480040 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-fd79d664-c884-413e-86b2-a51070966dbe tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:09.480960 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-fd79d664-c884-413e-86b2-a51070966dbe tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:09.481417 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-fd79d664-c884-413e-86b2-a51070966dbe tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:09.576126 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-ce6ff9f9-757e-435d-9948-c014881d3b22 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db87258db1424ce7a8399fdd05efe3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89d1b21ad8471a8a9a82adac2594c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:36:09.589056 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-ce6ff9f9-757e-435d-9948-c014881d3b22 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] 10.222.0.45 "GET /compute/v2.1/servers/06ae865a-6ba5-4198-be6d-e6056e645411" status: 200 len: 1322 microversion: 2.1 time: 0.445564 Jan 21 09:36:09.589690 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 26/63] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:36:09 2022] GET /compute/v2.1/servers/06ae865a-6ba5-4198-be6d-e6056e645411 => generated 1322 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 09:36:09.778057 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-fd79d664-c884-413e-86b2-a51070966dbe tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7b2c14d9444d65ab7a874e749671bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3390729231b409e9a83376b428c1a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:36:09.797914 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-fd79d664-c884-413e-86b2-a51070966dbe tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] 10.222.0.45 "GET /compute/v2.1/servers/370b78d2-d154-4c93-b8ef-3723bd26c3d4" status: 200 len: 1317 microversion: 2.1 time: 0.337123 Jan 21 09:36:09.809850 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 38/64] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:36:09 2022] GET /compute/v2.1/servers/370b78d2-d154-4c93-b8ef-3723bd26c3d4 => generated 1317 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:36:09.852091 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-2d4c8abf-0bdc-4d27-b607-428d798c108a tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:36:09.852091 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-2d4c8abf-0bdc-4d27-b607-428d798c108a tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] [instance: b50feb40-c691-4724-8570-f5873bdc5d1e] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:36:09.852091 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-2d4c8abf-0bdc-4d27-b607-428d798c108a tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:09.852091 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-2d4c8abf-0bdc-4d27-b607-428d798c108a tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:09.853888 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-2d4c8abf-0bdc-4d27-b607-428d798c108a tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:09.853888 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-2d4c8abf-0bdc-4d27-b607-428d798c108a tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:10.022618 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-2d4c8abf-0bdc-4d27-b607-428d798c108a tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b547a45bb54a8f94e9e5f5aeba7520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a31f7136c241578473d4d323722c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:36:10.030069 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-2d4c8abf-0bdc-4d27-b607-428d798c108a tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] 10.222.0.45 "GET /compute/v2.1/servers/b50feb40-c691-4724-8570-f5873bdc5d1e" status: 200 len: 1315 microversion: 2.1 time: 0.219033 Jan 21 09:36:10.030960 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 39/65] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:36:09 2022] GET /compute/v2.1/servers/b50feb40-c691-4724-8570-f5873bdc5d1e => generated 1315 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:36:10.098513 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [req-17ff172e-2011-449a-ad6e-0b5955a41869 req-388b9158-8dfa-44b9-a0a3-6680ec380760 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b50feb40-c691-4724-8570-f5873bdc5d1e", "tag": "dde72027-8017-427e-a871-c6be683d8168"}]} {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:36:10.099858 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 21 09:36:10.099858 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: warnings.warn(msg) Jan 21 09:36:10.112610 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [req-17ff172e-2011-449a-ad6e-0b5955a41869 req-388b9158-8dfa-44b9-a0a3-6680ec380760 service nova] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:10.113472 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [req-17ff172e-2011-449a-ad6e-0b5955a41869 req-388b9158-8dfa-44b9-a0a3-6680ec380760 service nova] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:10.143315 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.compute.server_external_events [req-17ff172e-2011-449a-ad6e-0b5955a41869 req-388b9158-8dfa-44b9-a0a3-6680ec380760 service nova] Creating event network-changed:dde72027-8017-427e-a871-c6be683d8168 for instance b50feb40-c691-4724-8570-f5873bdc5d1e on hv-cinder-80403 Jan 21 09:36:10.143867 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [req-17ff172e-2011-449a-ad6e-0b5955a41869 req-388b9158-8dfa-44b9-a0a3-6680ec380760 service nova] Acquired lock "compute-rpcapi-router" {{(pid=123386) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jan 21 09:36:10.145072 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-d6b57db0-0a91-4374-bb8f-84f0e2968e39 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:10.145556 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-d6b57db0-0a91-4374-bb8f-84f0e2968e39 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:10.146383 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-d6b57db0-0a91-4374-bb8f-84f0e2968e39 None None] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:10.146837 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-d6b57db0-0a91-4374-bb8f-84f0e2968e39 None None] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:10.157381 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.compute.rpcapi [None req-d6b57db0-0a91-4374-bb8f-84f0e2968e39 None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Jan 21 09:36:10.158289 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-d6b57db0-0a91-4374-bb8f-84f0e2968e39 None None] Releasing lock "compute-rpcapi-router" {{(pid=123386) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jan 21 09:36:10.180022 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-d6b57db0-0a91-4374-bb8f-84f0e2968e39 None None] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.556073 Jan 21 09:36:10.181806 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 27/66] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Jan 21 09:36:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 09:36:10.183468 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-8b21c01f-ac6e-4eb4-8d12-1fba1b24f5e0 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:36:10.183962 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-8b21c01f-ac6e-4eb4-8d12-1fba1b24f5e0 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] [instance: 59ad64a5-af93-44ef-8031-fd2f2d18a901] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:36:10.191339 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-8b21c01f-ac6e-4eb4-8d12-1fba1b24f5e0 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:10.192017 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-8b21c01f-ac6e-4eb4-8d12-1fba1b24f5e0 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:10.193057 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-8b21c01f-ac6e-4eb4-8d12-1fba1b24f5e0 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:10.193667 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-8b21c01f-ac6e-4eb4-8d12-1fba1b24f5e0 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:10.259488 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-8b21c01f-ac6e-4eb4-8d12-1fba1b24f5e0 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:36:10.268900 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-8b21c01f-ac6e-4eb4-8d12-1fba1b24f5e0 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:36:10.270683 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-8b21c01f-ac6e-4eb4-8d12-1fba1b24f5e0 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:36:10.273435 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-8b21c01f-ac6e-4eb4-8d12-1fba1b24f5e0 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "GET /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901" status: 200 len: 1333 microversion: 2.20 time: 0.094017 Jan 21 09:36:10.281312 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 40/67] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jan 21 09:36:10 2022] GET /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901 => generated 1333 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 21 09:36:10.391065 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [req-1d664978-271b-46c3-8474-9bbf28a61f38 req-eb3d1d6b-5708-4c88-829a-6697ce3a7764 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "370b78d2-d154-4c93-b8ef-3723bd26c3d4", "tag": "af30d40e-e03c-4e1e-a789-41a34ac8bec6"}]} {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:36:10.393033 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 21 09:36:10.393033 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: warnings.warn(msg) Jan 21 09:36:10.401061 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [req-1d664978-271b-46c3-8474-9bbf28a61f38 req-eb3d1d6b-5708-4c88-829a-6697ce3a7764 service nova] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:10.401567 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [req-1d664978-271b-46c3-8474-9bbf28a61f38 req-eb3d1d6b-5708-4c88-829a-6697ce3a7764 service nova] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:10.414187 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.compute.server_external_events [req-1d664978-271b-46c3-8474-9bbf28a61f38 req-eb3d1d6b-5708-4c88-829a-6697ce3a7764 service nova] Creating event network-changed:af30d40e-e03c-4e1e-a789-41a34ac8bec6 for instance 370b78d2-d154-4c93-b8ef-3723bd26c3d4 on hv-cinder-80403 Jan 21 09:36:10.419037 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [req-1d664978-271b-46c3-8474-9bbf28a61f38 req-eb3d1d6b-5708-4c88-829a-6697ce3a7764 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.117842 Jan 21 09:36:10.423450 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 28/68] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Jan 21 09:36:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 21 09:36:10.605435 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-f8965a8f-5f2a-4445-8a0e-e0bcdb82aca8 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:36:10.606074 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-f8965a8f-5f2a-4445-8a0e-e0bcdb82aca8 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] [instance: 06ae865a-6ba5-4198-be6d-e6056e645411] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:36:10.612777 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-f8965a8f-5f2a-4445-8a0e-e0bcdb82aca8 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:10.613520 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-f8965a8f-5f2a-4445-8a0e-e0bcdb82aca8 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:10.614319 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-f8965a8f-5f2a-4445-8a0e-e0bcdb82aca8 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:10.614760 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-f8965a8f-5f2a-4445-8a0e-e0bcdb82aca8 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:10.769599 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-f8965a8f-5f2a-4445-8a0e-e0bcdb82aca8 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db87258db1424ce7a8399fdd05efe3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89d1b21ad8471a8a9a82adac2594c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:36:10.782547 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-f8965a8f-5f2a-4445-8a0e-e0bcdb82aca8 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] 10.222.0.45 "GET /compute/v2.1/servers/06ae865a-6ba5-4198-be6d-e6056e645411" status: 200 len: 1322 microversion: 2.1 time: 0.180943 Jan 21 09:36:10.783067 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 41/69] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:36:10 2022] GET /compute/v2.1/servers/06ae865a-6ba5-4198-be6d-e6056e645411 => generated 1322 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:36:10.817390 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-bfb37dec-0ff3-44f8-9d88-cce24ff0bf89 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:36:10.818090 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-bfb37dec-0ff3-44f8-9d88-cce24ff0bf89 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] [instance: 370b78d2-d154-4c93-b8ef-3723bd26c3d4] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:36:10.824744 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-bfb37dec-0ff3-44f8-9d88-cce24ff0bf89 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:10.825232 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-bfb37dec-0ff3-44f8-9d88-cce24ff0bf89 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:10.826023 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-bfb37dec-0ff3-44f8-9d88-cce24ff0bf89 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:10.826479 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-bfb37dec-0ff3-44f8-9d88-cce24ff0bf89 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:10.987860 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-bfb37dec-0ff3-44f8-9d88-cce24ff0bf89 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7b2c14d9444d65ab7a874e749671bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3390729231b409e9a83376b428c1a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:36:10.995823 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-bfb37dec-0ff3-44f8-9d88-cce24ff0bf89 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] 10.222.0.45 "GET /compute/v2.1/servers/370b78d2-d154-4c93-b8ef-3723bd26c3d4" status: 200 len: 1317 microversion: 2.1 time: 0.182420 Jan 21 09:36:10.996578 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 29/70] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:36:10 2022] GET /compute/v2.1/servers/370b78d2-d154-4c93-b8ef-3723bd26c3d4 => generated 1317 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:36:11.057566 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-78260593-d54a-40dc-b24a-3f6fd58e0819 tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:36:11.058917 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-78260593-d54a-40dc-b24a-3f6fd58e0819 tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] [instance: b50feb40-c691-4724-8570-f5873bdc5d1e] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:36:11.066579 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-78260593-d54a-40dc-b24a-3f6fd58e0819 tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:11.071199 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-78260593-d54a-40dc-b24a-3f6fd58e0819 tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:11.072257 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-78260593-d54a-40dc-b24a-3f6fd58e0819 tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:11.072821 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-78260593-d54a-40dc-b24a-3f6fd58e0819 tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:11.245728 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-78260593-d54a-40dc-b24a-3f6fd58e0819 tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b547a45bb54a8f94e9e5f5aeba7520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a31f7136c241578473d4d323722c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:36:11.257392 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-78260593-d54a-40dc-b24a-3f6fd58e0819 tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] 10.222.0.45 "GET /compute/v2.1/servers/b50feb40-c691-4724-8570-f5873bdc5d1e" status: 200 len: 1315 microversion: 2.1 time: 0.212969 Jan 21 09:36:11.258079 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 42/71] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:36:11 2022] GET /compute/v2.1/servers/b50feb40-c691-4724-8570-f5873bdc5d1e => generated 1315 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 09:36:11.297361 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-e76aacfe-e3dc-4c00-b60a-a562a1a9d3a6 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:36:11.298511 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-e76aacfe-e3dc-4c00-b60a-a562a1a9d3a6 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] [instance: 59ad64a5-af93-44ef-8031-fd2f2d18a901] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:36:11.307869 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-e76aacfe-e3dc-4c00-b60a-a562a1a9d3a6 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:11.308429 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-e76aacfe-e3dc-4c00-b60a-a562a1a9d3a6 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:11.309401 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-e76aacfe-e3dc-4c00-b60a-a562a1a9d3a6 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:11.309934 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-e76aacfe-e3dc-4c00-b60a-a562a1a9d3a6 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:11.380306 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-e76aacfe-e3dc-4c00-b60a-a562a1a9d3a6 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:36:11.389086 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-e76aacfe-e3dc-4c00-b60a-a562a1a9d3a6 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:36:11.390784 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-e76aacfe-e3dc-4c00-b60a-a562a1a9d3a6 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:36:11.391865 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-e76aacfe-e3dc-4c00-b60a-a562a1a9d3a6 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "GET /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901" status: 200 len: 1333 microversion: 2.20 time: 0.101808 Jan 21 09:36:11.393949 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 30/72] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jan 21 09:36:11 2022] GET /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901 => generated 1333 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 21 09:36:11.802650 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-3b12912d-11c6-4923-aa15-90cf7ac4fcca tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:36:11.803717 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-3b12912d-11c6-4923-aa15-90cf7ac4fcca tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] [instance: 06ae865a-6ba5-4198-be6d-e6056e645411] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:36:11.814708 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-3b12912d-11c6-4923-aa15-90cf7ac4fcca tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:11.815304 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-3b12912d-11c6-4923-aa15-90cf7ac4fcca tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:11.816105 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-3b12912d-11c6-4923-aa15-90cf7ac4fcca tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:11.816570 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-3b12912d-11c6-4923-aa15-90cf7ac4fcca tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:12.013813 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-11d5bd65-157f-44a6-b54f-50a4d87e9e50 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:36:12.014708 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-11d5bd65-157f-44a6-b54f-50a4d87e9e50 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] [instance: 370b78d2-d154-4c93-b8ef-3723bd26c3d4] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:36:12.044144 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-11d5bd65-157f-44a6-b54f-50a4d87e9e50 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:12.044592 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-11d5bd65-157f-44a6-b54f-50a4d87e9e50 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:12.054280 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-11d5bd65-157f-44a6-b54f-50a4d87e9e50 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:12.054884 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-11d5bd65-157f-44a6-b54f-50a4d87e9e50 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:12.072766 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-3b12912d-11c6-4923-aa15-90cf7ac4fcca tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db87258db1424ce7a8399fdd05efe3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89d1b21ad8471a8a9a82adac2594c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:36:12.088650 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-3b12912d-11c6-4923-aa15-90cf7ac4fcca tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] 10.222.0.45 "GET /compute/v2.1/servers/06ae865a-6ba5-4198-be6d-e6056e645411" status: 200 len: 1322 microversion: 2.1 time: 0.290730 Jan 21 09:36:12.091281 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 43/73] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:36:11 2022] GET /compute/v2.1/servers/06ae865a-6ba5-4198-be6d-e6056e645411 => generated 1322 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:36:12.286551 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-4a424978-38c9-4866-b7f5-601991f4fe58 tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:36:12.287166 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-4a424978-38c9-4866-b7f5-601991f4fe58 tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] [instance: b50feb40-c691-4724-8570-f5873bdc5d1e] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:36:12.297812 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-4a424978-38c9-4866-b7f5-601991f4fe58 tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:12.297812 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-4a424978-38c9-4866-b7f5-601991f4fe58 tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:12.298347 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-4a424978-38c9-4866-b7f5-601991f4fe58 tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:12.298935 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-4a424978-38c9-4866-b7f5-601991f4fe58 tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:12.319645 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-11d5bd65-157f-44a6-b54f-50a4d87e9e50 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7b2c14d9444d65ab7a874e749671bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3390729231b409e9a83376b428c1a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:36:12.327932 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-11d5bd65-157f-44a6-b54f-50a4d87e9e50 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] 10.222.0.45 "GET /compute/v2.1/servers/370b78d2-d154-4c93-b8ef-3723bd26c3d4" status: 200 len: 1317 microversion: 2.1 time: 0.317839 Jan 21 09:36:12.334109 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 31/74] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:36:12 2022] GET /compute/v2.1/servers/370b78d2-d154-4c93-b8ef-3723bd26c3d4 => generated 1317 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:36:12.421311 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-ec36f488-d002-4c44-95ea-ed88bf0ba76a tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:36:12.422310 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-ec36f488-d002-4c44-95ea-ed88bf0ba76a tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] [instance: 59ad64a5-af93-44ef-8031-fd2f2d18a901] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:36:12.433203 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-ec36f488-d002-4c44-95ea-ed88bf0ba76a tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:12.434133 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-ec36f488-d002-4c44-95ea-ed88bf0ba76a tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:12.435249 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-ec36f488-d002-4c44-95ea-ed88bf0ba76a tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:12.435836 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-ec36f488-d002-4c44-95ea-ed88bf0ba76a tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:12.472720 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-4a424978-38c9-4866-b7f5-601991f4fe58 tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b547a45bb54a8f94e9e5f5aeba7520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a31f7136c241578473d4d323722c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:36:12.486114 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-4a424978-38c9-4866-b7f5-601991f4fe58 tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] 10.222.0.45 "GET /compute/v2.1/servers/b50feb40-c691-4724-8570-f5873bdc5d1e" status: 200 len: 1315 microversion: 2.1 time: 0.202540 Jan 21 09:36:12.499847 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 44/75] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:36:12 2022] GET /compute/v2.1/servers/b50feb40-c691-4724-8570-f5873bdc5d1e => generated 1315 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 09:36:12.505880 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [req-942106a7-97d3-4164-b947-dc781e62cf42 req-bc58dd26-e2d3-4ce6-a7d1-d4f9f76c330b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "06ae865a-6ba5-4198-be6d-e6056e645411", "tag": "2b16cf8c-7e83-4177-a9ae-f7516c48e617"}, {"name": "network-changed", "server_uuid": "4e67b25e-7e65-4975-bafa-fceafcd53647", "tag": "9eccc2a4-ddb6-4675-9f12-63953114fa21"}]} {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:36:12.509695 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-ec36f488-d002-4c44-95ea-ed88bf0ba76a tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:36:12.510320 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 21 09:36:12.510320 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: warnings.warn(msg) Jan 21 09:36:12.519032 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-ec36f488-d002-4c44-95ea-ed88bf0ba76a tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:36:12.520573 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-ec36f488-d002-4c44-95ea-ed88bf0ba76a tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:36:12.521781 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-ec36f488-d002-4c44-95ea-ed88bf0ba76a tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "GET /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901" status: 200 len: 1341 microversion: 2.20 time: 0.104278 Jan 21 09:36:12.522849 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [req-942106a7-97d3-4164-b947-dc781e62cf42 req-bc58dd26-e2d3-4ce6-a7d1-d4f9f76c330b service nova] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:12.523280 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 32/76] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jan 21 09:36:12 2022] GET /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901 => generated 1341 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 21 09:36:12.523396 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [req-942106a7-97d3-4164-b947-dc781e62cf42 req-bc58dd26-e2d3-4ce6-a7d1-d4f9f76c330b service nova] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:12.550104 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.compute.server_external_events [req-942106a7-97d3-4164-b947-dc781e62cf42 req-bc58dd26-e2d3-4ce6-a7d1-d4f9f76c330b service nova] Creating event network-changed:2b16cf8c-7e83-4177-a9ae-f7516c48e617 for instance 06ae865a-6ba5-4198-be6d-e6056e645411 on hv-cinder-80403 Jan 21 09:36:12.550642 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.compute.server_external_events [req-942106a7-97d3-4164-b947-dc781e62cf42 req-bc58dd26-e2d3-4ce6-a7d1-d4f9f76c330b service nova] Creating event network-changed:9eccc2a4-ddb6-4675-9f12-63953114fa21 for instance 4e67b25e-7e65-4975-bafa-fceafcd53647 on hv-cinder-80403 Jan 21 09:36:12.551335 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [req-942106a7-97d3-4164-b947-dc781e62cf42 req-bc58dd26-e2d3-4ce6-a7d1-d4f9f76c330b service nova] Acquired lock "compute-rpcapi-router" {{(pid=123387) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jan 21 09:36:12.552543 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-7e51dcca-9143-4a64-bca5-def6c13ca6de None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:12.552997 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-7e51dcca-9143-4a64-bca5-def6c13ca6de None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:12.554193 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-7e51dcca-9143-4a64-bca5-def6c13ca6de None None] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:12.554628 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-7e51dcca-9143-4a64-bca5-def6c13ca6de None None] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:12.592620 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.compute.rpcapi [None req-7e51dcca-9143-4a64-bca5-def6c13ca6de None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Jan 21 09:36:12.592620 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-7e51dcca-9143-4a64-bca5-def6c13ca6de None None] Releasing lock "compute-rpcapi-router" {{(pid=123387) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jan 21 09:36:12.592620 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-7e51dcca-9143-4a64-bca5-def6c13ca6de None None] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.083472 Jan 21 09:36:12.592620 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 45/77] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Jan 21 09:36:12 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 09:36:13.109063 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-a7f1d519-5c7f-4593-9c39-8a11d0975c08 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:36:13.109783 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-a7f1d519-5c7f-4593-9c39-8a11d0975c08 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] [instance: 06ae865a-6ba5-4198-be6d-e6056e645411] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:36:13.119179 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-a7f1d519-5c7f-4593-9c39-8a11d0975c08 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:13.119655 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-a7f1d519-5c7f-4593-9c39-8a11d0975c08 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:13.120462 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-a7f1d519-5c7f-4593-9c39-8a11d0975c08 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:13.120893 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-a7f1d519-5c7f-4593-9c39-8a11d0975c08 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:13.271047 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-a7f1d519-5c7f-4593-9c39-8a11d0975c08 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db87258db1424ce7a8399fdd05efe3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89d1b21ad8471a8a9a82adac2594c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:36:13.279265 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-a7f1d519-5c7f-4593-9c39-8a11d0975c08 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] 10.222.0.45 "GET /compute/v2.1/servers/06ae865a-6ba5-4198-be6d-e6056e645411" status: 200 len: 1322 microversion: 2.1 time: 0.175043 Jan 21 09:36:13.279846 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 33/78] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:36:13 2022] GET /compute/v2.1/servers/06ae865a-6ba5-4198-be6d-e6056e645411 => generated 1322 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:36:13.352602 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-b90e0312-1e76-48c8-b8be-98b41fe00015 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:36:13.353321 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-b90e0312-1e76-48c8-b8be-98b41fe00015 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] [instance: 370b78d2-d154-4c93-b8ef-3723bd26c3d4] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:36:13.360284 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-b90e0312-1e76-48c8-b8be-98b41fe00015 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:13.362772 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-b90e0312-1e76-48c8-b8be-98b41fe00015 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:13.363939 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-b90e0312-1e76-48c8-b8be-98b41fe00015 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:13.364572 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-b90e0312-1e76-48c8-b8be-98b41fe00015 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:13.510640 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-8771ec7d-53d9-4e65-9ae6-87b8415ebdf3 tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:36:13.512294 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-8771ec7d-53d9-4e65-9ae6-87b8415ebdf3 tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] [instance: b50feb40-c691-4724-8570-f5873bdc5d1e] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:36:13.521025 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-8771ec7d-53d9-4e65-9ae6-87b8415ebdf3 tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:13.522001 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-8771ec7d-53d9-4e65-9ae6-87b8415ebdf3 tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:13.523584 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-8771ec7d-53d9-4e65-9ae6-87b8415ebdf3 tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:13.524862 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-8771ec7d-53d9-4e65-9ae6-87b8415ebdf3 tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:13.529795 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-b90e0312-1e76-48c8-b8be-98b41fe00015 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7b2c14d9444d65ab7a874e749671bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3390729231b409e9a83376b428c1a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:36:13.540463 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-b90e0312-1e76-48c8-b8be-98b41fe00015 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] 10.222.0.45 "GET /compute/v2.1/servers/370b78d2-d154-4c93-b8ef-3723bd26c3d4" status: 200 len: 1317 microversion: 2.1 time: 0.191970 Jan 21 09:36:13.550951 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 46/79] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:36:13 2022] GET /compute/v2.1/servers/370b78d2-d154-4c93-b8ef-3723bd26c3d4 => generated 1317 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:36:13.556293 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-049f3a4f-43cc-4dee-88f9-895294b20cfe tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:36:13.556914 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-049f3a4f-43cc-4dee-88f9-895294b20cfe tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] [instance: 59ad64a5-af93-44ef-8031-fd2f2d18a901] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:36:13.563222 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-049f3a4f-43cc-4dee-88f9-895294b20cfe tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:13.563680 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-049f3a4f-43cc-4dee-88f9-895294b20cfe tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:13.564530 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-049f3a4f-43cc-4dee-88f9-895294b20cfe tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:13.564997 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-049f3a4f-43cc-4dee-88f9-895294b20cfe tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:13.660108 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-049f3a4f-43cc-4dee-88f9-895294b20cfe tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:36:13.670935 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-049f3a4f-43cc-4dee-88f9-895294b20cfe tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:36:13.673461 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-049f3a4f-43cc-4dee-88f9-895294b20cfe tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:36:13.675130 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-049f3a4f-43cc-4dee-88f9-895294b20cfe tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "GET /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901" status: 200 len: 1341 microversion: 2.20 time: 0.122991 Jan 21 09:36:13.676488 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 47/80] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jan 21 09:36:13 2022] GET /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901 => generated 1341 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 21 09:36:13.764042 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-8771ec7d-53d9-4e65-9ae6-87b8415ebdf3 tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b547a45bb54a8f94e9e5f5aeba7520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a31f7136c241578473d4d323722c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:36:13.776095 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-8771ec7d-53d9-4e65-9ae6-87b8415ebdf3 tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] 10.222.0.45 "GET /compute/v2.1/servers/b50feb40-c691-4724-8570-f5873bdc5d1e" status: 200 len: 1315 microversion: 2.1 time: 0.273273 Jan 21 09:36:13.777258 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 34/81] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:36:13 2022] GET /compute/v2.1/servers/b50feb40-c691-4724-8570-f5873bdc5d1e => generated 1315 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:36:14.305760 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-42e0e1fa-0d78-4867-87dd-670fa69956c1 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:36:14.305760 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-42e0e1fa-0d78-4867-87dd-670fa69956c1 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] [instance: 06ae865a-6ba5-4198-be6d-e6056e645411] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:36:14.312908 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-42e0e1fa-0d78-4867-87dd-670fa69956c1 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:14.313466 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-42e0e1fa-0d78-4867-87dd-670fa69956c1 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:14.314266 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-42e0e1fa-0d78-4867-87dd-670fa69956c1 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:14.314760 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-42e0e1fa-0d78-4867-87dd-670fa69956c1 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:14.558279 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-666662a4-faf8-4a0d-91b0-c48b0be9aa12 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:36:14.559829 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-666662a4-faf8-4a0d-91b0-c48b0be9aa12 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] [instance: 370b78d2-d154-4c93-b8ef-3723bd26c3d4] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:36:14.567196 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-666662a4-faf8-4a0d-91b0-c48b0be9aa12 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:14.567857 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-666662a4-faf8-4a0d-91b0-c48b0be9aa12 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:14.568914 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-666662a4-faf8-4a0d-91b0-c48b0be9aa12 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:14.569725 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-666662a4-faf8-4a0d-91b0-c48b0be9aa12 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:14.716977 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-42e0e1fa-0d78-4867-87dd-670fa69956c1 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db87258db1424ce7a8399fdd05efe3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89d1b21ad8471a8a9a82adac2594c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:36:14.726894 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-42e0e1fa-0d78-4867-87dd-670fa69956c1 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] 10.222.0.45 "GET /compute/v2.1/servers/06ae865a-6ba5-4198-be6d-e6056e645411" status: 200 len: 1322 microversion: 2.1 time: 0.433149 Jan 21 09:36:14.727490 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 48/82] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:36:14 2022] GET /compute/v2.1/servers/06ae865a-6ba5-4198-be6d-e6056e645411 => generated 1322 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:36:14.743246 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-beb91c0e-ab80-406d-b117-0b21dce5e855 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:36:14.743867 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-beb91c0e-ab80-406d-b117-0b21dce5e855 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] [instance: 59ad64a5-af93-44ef-8031-fd2f2d18a901] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:36:14.750396 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-beb91c0e-ab80-406d-b117-0b21dce5e855 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:14.750865 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-beb91c0e-ab80-406d-b117-0b21dce5e855 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:14.751630 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-beb91c0e-ab80-406d-b117-0b21dce5e855 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:14.752231 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-beb91c0e-ab80-406d-b117-0b21dce5e855 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:14.836686 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-beb91c0e-ab80-406d-b117-0b21dce5e855 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:36:14.840325 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-666662a4-faf8-4a0d-91b0-c48b0be9aa12 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7b2c14d9444d65ab7a874e749671bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3390729231b409e9a83376b428c1a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:36:14.845131 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-beb91c0e-ab80-406d-b117-0b21dce5e855 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:36:14.846679 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-beb91c0e-ab80-406d-b117-0b21dce5e855 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:36:14.847785 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-beb91c0e-ab80-406d-b117-0b21dce5e855 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "GET /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901" status: 200 len: 1339 microversion: 2.20 time: 0.119212 Jan 21 09:36:14.848347 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 49/83] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jan 21 09:36:14 2022] GET /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901 => generated 1339 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 21 09:36:14.852261 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-666662a4-faf8-4a0d-91b0-c48b0be9aa12 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] 10.222.0.45 "GET /compute/v2.1/servers/370b78d2-d154-4c93-b8ef-3723bd26c3d4" status: 200 len: 1317 microversion: 2.1 time: 0.297908 Jan 21 09:36:14.861765 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 35/84] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:36:14 2022] GET /compute/v2.1/servers/370b78d2-d154-4c93-b8ef-3723bd26c3d4 => generated 1317 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 09:36:14.862046 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-ffc591a9-bd52-48d5-98e6-3a1f73328309 tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:36:14.862046 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-ffc591a9-bd52-48d5-98e6-3a1f73328309 tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] [instance: b50feb40-c691-4724-8570-f5873bdc5d1e] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:36:14.868558 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-ffc591a9-bd52-48d5-98e6-3a1f73328309 tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:14.869010 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-ffc591a9-bd52-48d5-98e6-3a1f73328309 tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:14.869908 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-ffc591a9-bd52-48d5-98e6-3a1f73328309 tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:14.870348 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-ffc591a9-bd52-48d5-98e6-3a1f73328309 tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:15.191897 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-ffc591a9-bd52-48d5-98e6-3a1f73328309 tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b547a45bb54a8f94e9e5f5aeba7520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a31f7136c241578473d4d323722c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:36:15.201307 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-ffc591a9-bd52-48d5-98e6-3a1f73328309 tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] 10.222.0.45 "GET /compute/v2.1/servers/b50feb40-c691-4724-8570-f5873bdc5d1e" status: 200 len: 1315 microversion: 2.1 time: 0.351813 Jan 21 09:36:15.201895 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 50/85] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:36:14 2022] GET /compute/v2.1/servers/b50feb40-c691-4724-8570-f5873bdc5d1e => generated 1315 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:36:15.746893 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-bad98e5c-04f3-40fa-ad35-d7ebc74eb36c tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:36:15.747519 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-bad98e5c-04f3-40fa-ad35-d7ebc74eb36c tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] [instance: 06ae865a-6ba5-4198-be6d-e6056e645411] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:36:15.754779 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-bad98e5c-04f3-40fa-ad35-d7ebc74eb36c tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:15.755311 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-bad98e5c-04f3-40fa-ad35-d7ebc74eb36c tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:15.756169 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-bad98e5c-04f3-40fa-ad35-d7ebc74eb36c tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:15.757695 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-bad98e5c-04f3-40fa-ad35-d7ebc74eb36c tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:15.869427 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-07b1a8a9-98cd-4fba-a635-3ffeaee22e26 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:36:15.870049 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-07b1a8a9-98cd-4fba-a635-3ffeaee22e26 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] [instance: 59ad64a5-af93-44ef-8031-fd2f2d18a901] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:36:15.876181 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-07b1a8a9-98cd-4fba-a635-3ffeaee22e26 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:15.876898 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-07b1a8a9-98cd-4fba-a635-3ffeaee22e26 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:15.877716 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-07b1a8a9-98cd-4fba-a635-3ffeaee22e26 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:15.878294 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-07b1a8a9-98cd-4fba-a635-3ffeaee22e26 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:15.916891 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-bad98e5c-04f3-40fa-ad35-d7ebc74eb36c tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db87258db1424ce7a8399fdd05efe3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89d1b21ad8471a8a9a82adac2594c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:36:15.924007 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-bad98e5c-04f3-40fa-ad35-d7ebc74eb36c tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] 10.222.0.45 "GET /compute/v2.1/servers/06ae865a-6ba5-4198-be6d-e6056e645411" status: 200 len: 1322 microversion: 2.1 time: 0.184163 Jan 21 09:36:15.925235 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 36/86] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:36:15 2022] GET /compute/v2.1/servers/06ae865a-6ba5-4198-be6d-e6056e645411 => generated 1322 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:36:15.930686 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-d8743f77-606c-4ae1-a2ed-67c5eff92c89 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:36:15.931469 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-d8743f77-606c-4ae1-a2ed-67c5eff92c89 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] [instance: 370b78d2-d154-4c93-b8ef-3723bd26c3d4] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:36:15.939164 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-d8743f77-606c-4ae1-a2ed-67c5eff92c89 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:15.939609 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-d8743f77-606c-4ae1-a2ed-67c5eff92c89 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:15.940392 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-d8743f77-606c-4ae1-a2ed-67c5eff92c89 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:15.940882 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-d8743f77-606c-4ae1-a2ed-67c5eff92c89 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:15.961484 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-07b1a8a9-98cd-4fba-a635-3ffeaee22e26 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:36:15.972094 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-07b1a8a9-98cd-4fba-a635-3ffeaee22e26 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:36:15.974101 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-07b1a8a9-98cd-4fba-a635-3ffeaee22e26 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:36:15.976552 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-07b1a8a9-98cd-4fba-a635-3ffeaee22e26 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "GET /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901" status: 200 len: 1339 microversion: 2.20 time: 0.111725 Jan 21 09:36:15.977346 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 51/87] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jan 21 09:36:15 2022] GET /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901 => generated 1339 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 21 09:36:16.087140 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-d8743f77-606c-4ae1-a2ed-67c5eff92c89 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7b2c14d9444d65ab7a874e749671bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3390729231b409e9a83376b428c1a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:36:16.094654 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-d8743f77-606c-4ae1-a2ed-67c5eff92c89 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] 10.222.0.45 "GET /compute/v2.1/servers/370b78d2-d154-4c93-b8ef-3723bd26c3d4" status: 200 len: 1317 microversion: 2.1 time: 0.168070 Jan 21 09:36:16.095231 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 37/88] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:36:15 2022] GET /compute/v2.1/servers/370b78d2-d154-4c93-b8ef-3723bd26c3d4 => generated 1317 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:36:16.218958 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-3cc25794-6734-46ff-b84c-d873eb035d5b tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:36:16.219566 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-3cc25794-6734-46ff-b84c-d873eb035d5b tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] [instance: b50feb40-c691-4724-8570-f5873bdc5d1e] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:36:16.225604 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-3cc25794-6734-46ff-b84c-d873eb035d5b tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:16.226285 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-3cc25794-6734-46ff-b84c-d873eb035d5b tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:16.227075 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-3cc25794-6734-46ff-b84c-d873eb035d5b tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:16.227553 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-3cc25794-6734-46ff-b84c-d873eb035d5b tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:16.379453 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-3cc25794-6734-46ff-b84c-d873eb035d5b tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b547a45bb54a8f94e9e5f5aeba7520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a31f7136c241578473d4d323722c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:36:16.388364 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-3cc25794-6734-46ff-b84c-d873eb035d5b tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] 10.222.0.45 "GET /compute/v2.1/servers/b50feb40-c691-4724-8570-f5873bdc5d1e" status: 200 len: 1315 microversion: 2.1 time: 0.173158 Jan 21 09:36:16.389003 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 52/89] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:36:16 2022] GET /compute/v2.1/servers/b50feb40-c691-4724-8570-f5873bdc5d1e => generated 1315 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:36:16.941889 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-328b7910-e0c5-4af0-be07-cacb427f94e5 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:36:16.942578 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-328b7910-e0c5-4af0-be07-cacb427f94e5 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] [instance: 06ae865a-6ba5-4198-be6d-e6056e645411] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:36:16.949532 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-328b7910-e0c5-4af0-be07-cacb427f94e5 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:16.950083 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-328b7910-e0c5-4af0-be07-cacb427f94e5 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:16.951344 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-328b7910-e0c5-4af0-be07-cacb427f94e5 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:16.952137 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-328b7910-e0c5-4af0-be07-cacb427f94e5 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:16.995274 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-a61590c9-8dfc-44a6-bf0d-398a95cce046 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:36:17.016102 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-a61590c9-8dfc-44a6-bf0d-398a95cce046 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] [instance: 59ad64a5-af93-44ef-8031-fd2f2d18a901] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:36:17.032762 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-a61590c9-8dfc-44a6-bf0d-398a95cce046 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:17.033244 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-a61590c9-8dfc-44a6-bf0d-398a95cce046 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:17.034250 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-a61590c9-8dfc-44a6-bf0d-398a95cce046 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:17.034863 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-a61590c9-8dfc-44a6-bf0d-398a95cce046 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:17.128748 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-a61590c9-8dfc-44a6-bf0d-398a95cce046 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:36:17.143295 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-a61590c9-8dfc-44a6-bf0d-398a95cce046 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:36:17.151175 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-a61590c9-8dfc-44a6-bf0d-398a95cce046 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:36:17.151175 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-a61590c9-8dfc-44a6-bf0d-398a95cce046 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "GET /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901" status: 200 len: 1339 microversion: 2.20 time: 0.156224 Jan 21 09:36:17.160357 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 53/90] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jan 21 09:36:16 2022] GET /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901 => generated 1339 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 21 09:36:17.166530 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-c32db515-ef34-4787-b846-4d9d4e381867 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:36:17.167709 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-c32db515-ef34-4787-b846-4d9d4e381867 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] [instance: 370b78d2-d154-4c93-b8ef-3723bd26c3d4] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:36:17.180259 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-c32db515-ef34-4787-b846-4d9d4e381867 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:17.181710 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-c32db515-ef34-4787-b846-4d9d4e381867 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:17.183053 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-c32db515-ef34-4787-b846-4d9d4e381867 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:17.183730 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-c32db515-ef34-4787-b846-4d9d4e381867 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:17.236066 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-328b7910-e0c5-4af0-be07-cacb427f94e5 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db87258db1424ce7a8399fdd05efe3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89d1b21ad8471a8a9a82adac2594c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:36:17.249048 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-328b7910-e0c5-4af0-be07-cacb427f94e5 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] 10.222.0.45 "GET /compute/v2.1/servers/06ae865a-6ba5-4198-be6d-e6056e645411" status: 200 len: 1322 microversion: 2.1 time: 0.310635 Jan 21 09:36:17.259466 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 38/91] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:36:16 2022] GET /compute/v2.1/servers/06ae865a-6ba5-4198-be6d-e6056e645411 => generated 1322 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:36:17.414364 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-903b643a-b638-42fc-b4a3-ee167f12d078 tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:36:17.417353 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-903b643a-b638-42fc-b4a3-ee167f12d078 tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] [instance: b50feb40-c691-4724-8570-f5873bdc5d1e] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:36:17.454898 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-903b643a-b638-42fc-b4a3-ee167f12d078 tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:17.455396 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-903b643a-b638-42fc-b4a3-ee167f12d078 tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:17.456234 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-903b643a-b638-42fc-b4a3-ee167f12d078 tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:17.456675 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-903b643a-b638-42fc-b4a3-ee167f12d078 tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:17.754675 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-c32db515-ef34-4787-b846-4d9d4e381867 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7b2c14d9444d65ab7a874e749671bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3390729231b409e9a83376b428c1a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:36:17.773475 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-c32db515-ef34-4787-b846-4d9d4e381867 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] 10.222.0.45 "GET /compute/v2.1/servers/370b78d2-d154-4c93-b8ef-3723bd26c3d4" status: 200 len: 1317 microversion: 2.1 time: 0.610475 Jan 21 09:36:17.775465 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 54/92] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:36:17 2022] GET /compute/v2.1/servers/370b78d2-d154-4c93-b8ef-3723bd26c3d4 => generated 1317 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:36:18.047815 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-903b643a-b638-42fc-b4a3-ee167f12d078 tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b547a45bb54a8f94e9e5f5aeba7520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a31f7136c241578473d4d323722c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:36:18.056437 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-903b643a-b638-42fc-b4a3-ee167f12d078 tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] 10.222.0.45 "GET /compute/v2.1/servers/b50feb40-c691-4724-8570-f5873bdc5d1e" status: 200 len: 1315 microversion: 2.1 time: 0.653508 Jan 21 09:36:18.057320 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 39/93] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:36:17 2022] GET /compute/v2.1/servers/b50feb40-c691-4724-8570-f5873bdc5d1e => generated 1315 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:36:18.166041 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-139f0be8-9af3-477e-818e-967b2e9584ad tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:36:18.167279 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-139f0be8-9af3-477e-818e-967b2e9584ad tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] [instance: 59ad64a5-af93-44ef-8031-fd2f2d18a901] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:36:18.174000 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-139f0be8-9af3-477e-818e-967b2e9584ad tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:18.174778 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-139f0be8-9af3-477e-818e-967b2e9584ad tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:18.175865 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-139f0be8-9af3-477e-818e-967b2e9584ad tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:18.176426 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-139f0be8-9af3-477e-818e-967b2e9584ad tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:18.276033 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-139f0be8-9af3-477e-818e-967b2e9584ad tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:36:18.281912 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-96f22137-371b-4588-aa4e-c290f8954568 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:36:18.283276 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-96f22137-371b-4588-aa4e-c290f8954568 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] [instance: 06ae865a-6ba5-4198-be6d-e6056e645411] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:36:18.286635 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-139f0be8-9af3-477e-818e-967b2e9584ad tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:36:18.291307 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-139f0be8-9af3-477e-818e-967b2e9584ad tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:36:18.292958 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-139f0be8-9af3-477e-818e-967b2e9584ad tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "GET /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901" status: 200 len: 1339 microversion: 2.20 time: 0.130818 Jan 21 09:36:18.310070 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-96f22137-371b-4588-aa4e-c290f8954568 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:18.310070 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-96f22137-371b-4588-aa4e-c290f8954568 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:18.310070 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-96f22137-371b-4588-aa4e-c290f8954568 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:18.310070 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-96f22137-371b-4588-aa4e-c290f8954568 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:18.311465 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 55/94] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jan 21 09:36:18 2022] GET /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901 => generated 1339 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 21 09:36:18.799257 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-08e6ccdd-fcf9-47be-875c-a81a057de709 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:36:18.800175 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-08e6ccdd-fcf9-47be-875c-a81a057de709 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] [instance: 370b78d2-d154-4c93-b8ef-3723bd26c3d4] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:36:18.814044 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-08e6ccdd-fcf9-47be-875c-a81a057de709 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:18.814893 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-08e6ccdd-fcf9-47be-875c-a81a057de709 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:18.816204 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-08e6ccdd-fcf9-47be-875c-a81a057de709 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:18.816855 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-08e6ccdd-fcf9-47be-875c-a81a057de709 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:19.048749 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-96f22137-371b-4588-aa4e-c290f8954568 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db87258db1424ce7a8399fdd05efe3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89d1b21ad8471a8a9a82adac2594c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:36:19.063497 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-96f22137-371b-4588-aa4e-c290f8954568 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] 10.222.0.45 "GET /compute/v2.1/servers/06ae865a-6ba5-4198-be6d-e6056e645411" status: 200 len: 1322 microversion: 2.1 time: 0.793936 Jan 21 09:36:19.066706 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 40/95] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:36:18 2022] GET /compute/v2.1/servers/06ae865a-6ba5-4198-be6d-e6056e645411 => generated 1322 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:36:19.098860 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-47a6b280-5873-4cd8-95dd-1b2d0bd909cf tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:36:19.099509 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-47a6b280-5873-4cd8-95dd-1b2d0bd909cf tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] [instance: b50feb40-c691-4724-8570-f5873bdc5d1e] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:36:19.117918 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-47a6b280-5873-4cd8-95dd-1b2d0bd909cf tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:19.120044 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-47a6b280-5873-4cd8-95dd-1b2d0bd909cf tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:19.121216 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-47a6b280-5873-4cd8-95dd-1b2d0bd909cf tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:19.123443 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-47a6b280-5873-4cd8-95dd-1b2d0bd909cf tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:19.445307 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-08e6ccdd-fcf9-47be-875c-a81a057de709 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7b2c14d9444d65ab7a874e749671bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3390729231b409e9a83376b428c1a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:36:19.452816 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-08e6ccdd-fcf9-47be-875c-a81a057de709 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] 10.222.0.45 "GET /compute/v2.1/servers/370b78d2-d154-4c93-b8ef-3723bd26c3d4" status: 200 len: 1317 microversion: 2.1 time: 0.663918 Jan 21 09:36:19.456844 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 56/96] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:36:18 2022] GET /compute/v2.1/servers/370b78d2-d154-4c93-b8ef-3723bd26c3d4 => generated 1317 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:36:19.466863 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-ff17b377-ee65-4848-b130-a1d78678e82d tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:36:19.467476 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-ff17b377-ee65-4848-b130-a1d78678e82d tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] [instance: 59ad64a5-af93-44ef-8031-fd2f2d18a901] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:36:19.479792 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-ff17b377-ee65-4848-b130-a1d78678e82d tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:19.480293 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-ff17b377-ee65-4848-b130-a1d78678e82d tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:19.481189 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-ff17b377-ee65-4848-b130-a1d78678e82d tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:19.481607 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-ff17b377-ee65-4848-b130-a1d78678e82d tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:19.742622 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-47a6b280-5873-4cd8-95dd-1b2d0bd909cf tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b547a45bb54a8f94e9e5f5aeba7520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a31f7136c241578473d4d323722c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:36:19.752180 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-47a6b280-5873-4cd8-95dd-1b2d0bd909cf tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] 10.222.0.45 "GET /compute/v2.1/servers/b50feb40-c691-4724-8570-f5873bdc5d1e" status: 200 len: 1315 microversion: 2.1 time: 0.673624 Jan 21 09:36:19.753289 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 41/97] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:36:19 2022] GET /compute/v2.1/servers/b50feb40-c691-4724-8570-f5873bdc5d1e => generated 1315 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:36:19.823378 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-ff17b377-ee65-4848-b130-a1d78678e82d tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:36:19.832601 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-ff17b377-ee65-4848-b130-a1d78678e82d tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:36:19.834190 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-ff17b377-ee65-4848-b130-a1d78678e82d tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:36:19.835882 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-ff17b377-ee65-4848-b130-a1d78678e82d tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "GET /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901" status: 200 len: 1406 microversion: 2.20 time: 0.377944 Jan 21 09:36:19.841608 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 57/98] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jan 21 09:36:19 2022] GET /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901 => generated 1406 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 21 09:36:20.088839 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-2da4aa9d-646e-4c80-af13-a992d40f53d4 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:36:20.089617 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-2da4aa9d-646e-4c80-af13-a992d40f53d4 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] [instance: 06ae865a-6ba5-4198-be6d-e6056e645411] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:36:20.103214 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-2da4aa9d-646e-4c80-af13-a992d40f53d4 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:20.103931 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-2da4aa9d-646e-4c80-af13-a992d40f53d4 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:20.111967 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-2da4aa9d-646e-4c80-af13-a992d40f53d4 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:20.111967 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-2da4aa9d-646e-4c80-af13-a992d40f53d4 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:20.320648 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-2da4aa9d-646e-4c80-af13-a992d40f53d4 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db87258db1424ce7a8399fdd05efe3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89d1b21ad8471a8a9a82adac2594c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:36:20.332046 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [req-531f3a86-dbdd-458a-992d-2f421fb382c4 req-5e3e363d-a3d8-4a3a-b3dd-06585a270ba8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "59ad64a5-af93-44ef-8031-fd2f2d18a901", "tag": "63990fa3-fce3-4891-adb2-cd4ebc4c075a"}]} {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:36:20.333801 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 21 09:36:20.333801 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: warnings.warn(msg) Jan 21 09:36:20.335098 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-2da4aa9d-646e-4c80-af13-a992d40f53d4 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] 10.222.0.45 "GET /compute/v2.1/servers/06ae865a-6ba5-4198-be6d-e6056e645411" status: 200 len: 1322 microversion: 2.1 time: 0.257639 Jan 21 09:36:20.336421 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 42/99] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:36:20 2022] GET /compute/v2.1/servers/06ae865a-6ba5-4198-be6d-e6056e645411 => generated 1322 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:36:20.342722 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [req-531f3a86-dbdd-458a-992d-2f421fb382c4 req-5e3e363d-a3d8-4a3a-b3dd-06585a270ba8 service nova] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:20.343160 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [req-531f3a86-dbdd-458a-992d-2f421fb382c4 req-5e3e363d-a3d8-4a3a-b3dd-06585a270ba8 service nova] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:20.364625 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.compute.server_external_events [req-531f3a86-dbdd-458a-992d-2f421fb382c4 req-5e3e363d-a3d8-4a3a-b3dd-06585a270ba8 service nova] Creating event network-changed:63990fa3-fce3-4891-adb2-cd4ebc4c075a for instance 59ad64a5-af93-44ef-8031-fd2f2d18a901 on hv-cinder-80403 Jan 21 09:36:20.371518 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [req-531f3a86-dbdd-458a-992d-2f421fb382c4 req-5e3e363d-a3d8-4a3a-b3dd-06585a270ba8 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042957 Jan 21 09:36:20.373475 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 58/100] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Jan 21 09:36:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 09:36:20.470699 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-d0562b95-90ba-430c-afee-7bbc5b7ac42e tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:36:20.471519 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-d0562b95-90ba-430c-afee-7bbc5b7ac42e tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] [instance: 370b78d2-d154-4c93-b8ef-3723bd26c3d4] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:36:20.484095 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-d0562b95-90ba-430c-afee-7bbc5b7ac42e tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:20.486484 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-d0562b95-90ba-430c-afee-7bbc5b7ac42e tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:20.487662 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-d0562b95-90ba-430c-afee-7bbc5b7ac42e tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:20.489676 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-d0562b95-90ba-430c-afee-7bbc5b7ac42e tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:20.650289 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-d0562b95-90ba-430c-afee-7bbc5b7ac42e tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7b2c14d9444d65ab7a874e749671bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3390729231b409e9a83376b428c1a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:36:20.654216 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-d0562b95-90ba-430c-afee-7bbc5b7ac42e tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] 10.222.0.45 "GET /compute/v2.1/servers/370b78d2-d154-4c93-b8ef-3723bd26c3d4" status: 200 len: 1317 microversion: 2.1 time: 0.187575 Jan 21 09:36:20.666892 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 43/101] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:36:20 2022] GET /compute/v2.1/servers/370b78d2-d154-4c93-b8ef-3723bd26c3d4 => generated 1317 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:36:20.770532 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-9e087924-8d6e-4328-b29a-5849e14774e2 tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:36:20.771901 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-9e087924-8d6e-4328-b29a-5849e14774e2 tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] [instance: b50feb40-c691-4724-8570-f5873bdc5d1e] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:36:20.789313 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-9e087924-8d6e-4328-b29a-5849e14774e2 tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:20.790093 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-9e087924-8d6e-4328-b29a-5849e14774e2 tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:20.791030 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-9e087924-8d6e-4328-b29a-5849e14774e2 tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:20.791634 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-9e087924-8d6e-4328-b29a-5849e14774e2 tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:20.859444 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-86853bb9-c133-4d56-be21-41f308bfcce9 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:36:20.860057 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-86853bb9-c133-4d56-be21-41f308bfcce9 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] [instance: 59ad64a5-af93-44ef-8031-fd2f2d18a901] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:36:20.867370 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-86853bb9-c133-4d56-be21-41f308bfcce9 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:20.867824 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-86853bb9-c133-4d56-be21-41f308bfcce9 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:20.868613 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-86853bb9-c133-4d56-be21-41f308bfcce9 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:20.869246 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-86853bb9-c133-4d56-be21-41f308bfcce9 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:21.031815 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-9e087924-8d6e-4328-b29a-5849e14774e2 tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b547a45bb54a8f94e9e5f5aeba7520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a31f7136c241578473d4d323722c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:36:21.044575 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-9e087924-8d6e-4328-b29a-5849e14774e2 tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] 10.222.0.45 "GET /compute/v2.1/servers/b50feb40-c691-4724-8570-f5873bdc5d1e" status: 200 len: 1315 microversion: 2.1 time: 0.276172 Jan 21 09:36:21.045942 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 59/102] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:36:20 2022] GET /compute/v2.1/servers/b50feb40-c691-4724-8570-f5873bdc5d1e => generated 1315 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:36:21.091051 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-86853bb9-c133-4d56-be21-41f308bfcce9 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:36:21.100721 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-86853bb9-c133-4d56-be21-41f308bfcce9 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:36:21.102268 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-86853bb9-c133-4d56-be21-41f308bfcce9 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:36:21.103392 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-86853bb9-c133-4d56-be21-41f308bfcce9 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "GET /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901" status: 200 len: 1406 microversion: 2.20 time: 0.249902 Jan 21 09:36:21.104015 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 44/103] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jan 21 09:36:20 2022] GET /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901 => generated 1406 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 21 09:36:21.353280 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-d508bd45-0560-45ad-ad25-c393464b0f49 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:36:21.359539 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-d508bd45-0560-45ad-ad25-c393464b0f49 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] [instance: 06ae865a-6ba5-4198-be6d-e6056e645411] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:36:21.360125 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-d508bd45-0560-45ad-ad25-c393464b0f49 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:21.360580 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-d508bd45-0560-45ad-ad25-c393464b0f49 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:21.361404 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-d508bd45-0560-45ad-ad25-c393464b0f49 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:21.361843 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-d508bd45-0560-45ad-ad25-c393464b0f49 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:21.505244 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-d508bd45-0560-45ad-ad25-c393464b0f49 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db87258db1424ce7a8399fdd05efe3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89d1b21ad8471a8a9a82adac2594c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:36:21.513078 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-d508bd45-0560-45ad-ad25-c393464b0f49 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] 10.222.0.45 "GET /compute/v2.1/servers/06ae865a-6ba5-4198-be6d-e6056e645411" status: 200 len: 1322 microversion: 2.1 time: 0.165004 Jan 21 09:36:21.513878 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 60/104] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:36:21 2022] GET /compute/v2.1/servers/06ae865a-6ba5-4198-be6d-e6056e645411 => generated 1322 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:36:21.671225 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-d1c68889-0d4f-447c-9d0e-b24e9151f50d tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:36:21.672027 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-d1c68889-0d4f-447c-9d0e-b24e9151f50d tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] [instance: 370b78d2-d154-4c93-b8ef-3723bd26c3d4] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:36:21.683117 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-d1c68889-0d4f-447c-9d0e-b24e9151f50d tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:21.683647 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-d1c68889-0d4f-447c-9d0e-b24e9151f50d tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:21.684526 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-d1c68889-0d4f-447c-9d0e-b24e9151f50d tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:21.684989 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-d1c68889-0d4f-447c-9d0e-b24e9151f50d tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:21.828490 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-d1c68889-0d4f-447c-9d0e-b24e9151f50d tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7b2c14d9444d65ab7a874e749671bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3390729231b409e9a83376b428c1a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:36:21.836216 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-d1c68889-0d4f-447c-9d0e-b24e9151f50d tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] 10.222.0.45 "GET /compute/v2.1/servers/370b78d2-d154-4c93-b8ef-3723bd26c3d4" status: 200 len: 1317 microversion: 2.1 time: 0.169152 Jan 21 09:36:21.836851 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 45/105] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:36:21 2022] GET /compute/v2.1/servers/370b78d2-d154-4c93-b8ef-3723bd26c3d4 => generated 1317 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 09:36:22.061482 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-00bb3bac-4ebc-4c25-a2a3-8a1741c24d93 tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:36:22.062111 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-00bb3bac-4ebc-4c25-a2a3-8a1741c24d93 tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] [instance: b50feb40-c691-4724-8570-f5873bdc5d1e] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:36:22.068071 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-00bb3bac-4ebc-4c25-a2a3-8a1741c24d93 tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:22.068530 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-00bb3bac-4ebc-4c25-a2a3-8a1741c24d93 tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:22.069669 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-00bb3bac-4ebc-4c25-a2a3-8a1741c24d93 tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:22.070348 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-00bb3bac-4ebc-4c25-a2a3-8a1741c24d93 tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:22.121865 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-56d13228-a920-44fd-b541-32dcc543e757 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:36:22.122436 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-56d13228-a920-44fd-b541-32dcc543e757 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] [instance: 59ad64a5-af93-44ef-8031-fd2f2d18a901] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:36:22.128920 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-56d13228-a920-44fd-b541-32dcc543e757 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:22.129548 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-56d13228-a920-44fd-b541-32dcc543e757 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:22.130348 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-56d13228-a920-44fd-b541-32dcc543e757 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:22.130784 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-56d13228-a920-44fd-b541-32dcc543e757 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:22.259737 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-00bb3bac-4ebc-4c25-a2a3-8a1741c24d93 tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b547a45bb54a8f94e9e5f5aeba7520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a31f7136c241578473d4d323722c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:36:22.273829 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-00bb3bac-4ebc-4c25-a2a3-8a1741c24d93 tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] 10.222.0.45 "GET /compute/v2.1/servers/b50feb40-c691-4724-8570-f5873bdc5d1e" status: 200 len: 1315 microversion: 2.1 time: 0.210300 Jan 21 09:36:22.285740 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 61/106] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:36:22 2022] GET /compute/v2.1/servers/b50feb40-c691-4724-8570-f5873bdc5d1e => generated 1315 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:36:22.338755 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-56d13228-a920-44fd-b541-32dcc543e757 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:36:22.353074 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-56d13228-a920-44fd-b541-32dcc543e757 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:36:22.353074 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-56d13228-a920-44fd-b541-32dcc543e757 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:36:22.353074 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-56d13228-a920-44fd-b541-32dcc543e757 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "GET /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901" status: 200 len: 1406 microversion: 2.20 time: 0.234537 Jan 21 09:36:22.353340 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 46/107] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jan 21 09:36:22 2022] GET /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901 => generated 1406 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 21 09:36:22.530342 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-7e9fdf51-b6fc-4729-97c3-289ae6348ca9 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:36:22.530958 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-7e9fdf51-b6fc-4729-97c3-289ae6348ca9 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] [instance: 06ae865a-6ba5-4198-be6d-e6056e645411] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:36:22.536927 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-7e9fdf51-b6fc-4729-97c3-289ae6348ca9 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:22.544056 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-7e9fdf51-b6fc-4729-97c3-289ae6348ca9 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:22.544056 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-7e9fdf51-b6fc-4729-97c3-289ae6348ca9 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:22.544056 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-7e9fdf51-b6fc-4729-97c3-289ae6348ca9 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:22.698793 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-7e9fdf51-b6fc-4729-97c3-289ae6348ca9 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db87258db1424ce7a8399fdd05efe3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89d1b21ad8471a8a9a82adac2594c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:36:22.706943 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-7e9fdf51-b6fc-4729-97c3-289ae6348ca9 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] 10.222.0.45 "GET /compute/v2.1/servers/06ae865a-6ba5-4198-be6d-e6056e645411" status: 200 len: 1322 microversion: 2.1 time: 0.180148 Jan 21 09:36:22.707524 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 62/108] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:36:22 2022] GET /compute/v2.1/servers/06ae865a-6ba5-4198-be6d-e6056e645411 => generated 1322 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:36:22.853871 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-5a30b9fc-4e30-44d6-ada5-46b3e907b55f tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:36:22.854517 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-5a30b9fc-4e30-44d6-ada5-46b3e907b55f tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] [instance: 370b78d2-d154-4c93-b8ef-3723bd26c3d4] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:36:22.860524 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-5a30b9fc-4e30-44d6-ada5-46b3e907b55f tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:22.860727 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-5a30b9fc-4e30-44d6-ada5-46b3e907b55f tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:22.861555 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-5a30b9fc-4e30-44d6-ada5-46b3e907b55f tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:22.861994 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-5a30b9fc-4e30-44d6-ada5-46b3e907b55f tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:23.024820 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-5a30b9fc-4e30-44d6-ada5-46b3e907b55f tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7b2c14d9444d65ab7a874e749671bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3390729231b409e9a83376b428c1a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:36:23.032239 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-5a30b9fc-4e30-44d6-ada5-46b3e907b55f tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] 10.222.0.45 "GET /compute/v2.1/servers/370b78d2-d154-4c93-b8ef-3723bd26c3d4" status: 200 len: 1317 microversion: 2.1 time: 0.182885 Jan 21 09:36:23.042470 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 47/109] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:36:22 2022] GET /compute/v2.1/servers/370b78d2-d154-4c93-b8ef-3723bd26c3d4 => generated 1317 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:36:23.299988 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-e2d9a78e-842d-48e2-9b52-6b0da80660ae tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:36:23.300726 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-e2d9a78e-842d-48e2-9b52-6b0da80660ae tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] [instance: b50feb40-c691-4724-8570-f5873bdc5d1e] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:36:23.308000 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-e2d9a78e-842d-48e2-9b52-6b0da80660ae tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:23.308457 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-e2d9a78e-842d-48e2-9b52-6b0da80660ae tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:23.309263 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-e2d9a78e-842d-48e2-9b52-6b0da80660ae tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:23.309863 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-e2d9a78e-842d-48e2-9b52-6b0da80660ae tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:23.372114 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-e8e6ae79-b354-4eab-ab49-88466550db7f tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:36:23.372725 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-e8e6ae79-b354-4eab-ab49-88466550db7f tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] [instance: 59ad64a5-af93-44ef-8031-fd2f2d18a901] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:36:23.379653 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-e8e6ae79-b354-4eab-ab49-88466550db7f tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:23.380103 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-e8e6ae79-b354-4eab-ab49-88466550db7f tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:23.391350 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-e8e6ae79-b354-4eab-ab49-88466550db7f tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:23.392019 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-e8e6ae79-b354-4eab-ab49-88466550db7f tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:23.528022 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-e2d9a78e-842d-48e2-9b52-6b0da80660ae tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b547a45bb54a8f94e9e5f5aeba7520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a31f7136c241578473d4d323722c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:36:23.539930 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-e2d9a78e-842d-48e2-9b52-6b0da80660ae tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] 10.222.0.45 "GET /compute/v2.1/servers/b50feb40-c691-4724-8570-f5873bdc5d1e" status: 200 len: 1315 microversion: 2.1 time: 0.247327 Jan 21 09:36:23.562824 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 63/110] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:36:23 2022] GET /compute/v2.1/servers/b50feb40-c691-4724-8570-f5873bdc5d1e => generated 1315 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:36:23.602479 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-e8e6ae79-b354-4eab-ab49-88466550db7f tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:36:23.611868 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-e8e6ae79-b354-4eab-ab49-88466550db7f tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:36:23.617247 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-e8e6ae79-b354-4eab-ab49-88466550db7f tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:36:23.617247 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-e8e6ae79-b354-4eab-ab49-88466550db7f tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "GET /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901" status: 200 len: 1406 microversion: 2.20 time: 0.246576 Jan 21 09:36:23.617247 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 48/111] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jan 21 09:36:23 2022] GET /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901 => generated 1406 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 21 09:36:23.726917 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-da021c49-51f0-458f-95a9-27a8512f744b tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:36:23.727881 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-da021c49-51f0-458f-95a9-27a8512f744b tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] [instance: 06ae865a-6ba5-4198-be6d-e6056e645411] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:36:23.734780 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-da021c49-51f0-458f-95a9-27a8512f744b tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:23.735801 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-da021c49-51f0-458f-95a9-27a8512f744b tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:23.736602 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-da021c49-51f0-458f-95a9-27a8512f744b tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:23.737222 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-da021c49-51f0-458f-95a9-27a8512f744b tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:23.889341 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-da021c49-51f0-458f-95a9-27a8512f744b tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db87258db1424ce7a8399fdd05efe3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89d1b21ad8471a8a9a82adac2594c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:36:23.896605 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-da021c49-51f0-458f-95a9-27a8512f744b tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] 10.222.0.45 "GET /compute/v2.1/servers/06ae865a-6ba5-4198-be6d-e6056e645411" status: 200 len: 1322 microversion: 2.1 time: 0.176563 Jan 21 09:36:23.897284 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 64/112] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:36:23 2022] GET /compute/v2.1/servers/06ae865a-6ba5-4198-be6d-e6056e645411 => generated 1322 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:36:24.049509 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-5a0b52d6-5048-4b4e-9593-8437bada6123 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:36:24.049961 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-5a0b52d6-5048-4b4e-9593-8437bada6123 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] [instance: 370b78d2-d154-4c93-b8ef-3723bd26c3d4] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:36:24.056558 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-5a0b52d6-5048-4b4e-9593-8437bada6123 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:24.057273 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-5a0b52d6-5048-4b4e-9593-8437bada6123 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:24.058214 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-5a0b52d6-5048-4b4e-9593-8437bada6123 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:24.058789 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-5a0b52d6-5048-4b4e-9593-8437bada6123 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:24.214793 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-5a0b52d6-5048-4b4e-9593-8437bada6123 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7b2c14d9444d65ab7a874e749671bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3390729231b409e9a83376b428c1a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:36:24.221738 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-5a0b52d6-5048-4b4e-9593-8437bada6123 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] 10.222.0.45 "GET /compute/v2.1/servers/370b78d2-d154-4c93-b8ef-3723bd26c3d4" status: 200 len: 1317 microversion: 2.1 time: 0.175833 Jan 21 09:36:24.222621 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 49/113] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:36:24 2022] GET /compute/v2.1/servers/370b78d2-d154-4c93-b8ef-3723bd26c3d4 => generated 1317 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:36:24.557046 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-74a76611-afb3-4a65-a205-ccc2010c2547 tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:36:24.558776 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-74a76611-afb3-4a65-a205-ccc2010c2547 tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] [instance: b50feb40-c691-4724-8570-f5873bdc5d1e] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:36:24.564822 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-74a76611-afb3-4a65-a205-ccc2010c2547 tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:24.565294 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-74a76611-afb3-4a65-a205-ccc2010c2547 tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:24.567063 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-74a76611-afb3-4a65-a205-ccc2010c2547 tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:24.567708 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-74a76611-afb3-4a65-a205-ccc2010c2547 tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:24.635793 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-de832f23-8bb7-4564-863d-ba5d7f2ba066 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:36:24.636435 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-de832f23-8bb7-4564-863d-ba5d7f2ba066 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] [instance: 59ad64a5-af93-44ef-8031-fd2f2d18a901] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:36:24.643316 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-de832f23-8bb7-4564-863d-ba5d7f2ba066 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:24.643761 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-de832f23-8bb7-4564-863d-ba5d7f2ba066 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:24.649087 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-de832f23-8bb7-4564-863d-ba5d7f2ba066 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:24.649087 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-de832f23-8bb7-4564-863d-ba5d7f2ba066 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:24.810338 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-74a76611-afb3-4a65-a205-ccc2010c2547 tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b547a45bb54a8f94e9e5f5aeba7520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a31f7136c241578473d4d323722c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:36:24.831005 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-74a76611-afb3-4a65-a205-ccc2010c2547 tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] 10.222.0.45 "GET /compute/v2.1/servers/b50feb40-c691-4724-8570-f5873bdc5d1e" status: 200 len: 1315 microversion: 2.1 time: 0.277688 Jan 21 09:36:24.833798 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 65/114] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:36:24 2022] GET /compute/v2.1/servers/b50feb40-c691-4724-8570-f5873bdc5d1e => generated 1315 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:36:24.870088 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-de832f23-8bb7-4564-863d-ba5d7f2ba066 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:36:24.878513 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-de832f23-8bb7-4564-863d-ba5d7f2ba066 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:36:24.880148 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-de832f23-8bb7-4564-863d-ba5d7f2ba066 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:36:24.881655 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-de832f23-8bb7-4564-863d-ba5d7f2ba066 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "GET /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901" status: 200 len: 1406 microversion: 2.20 time: 0.252094 Jan 21 09:36:24.882438 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 50/115] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jan 21 09:36:24 2022] GET /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901 => generated 1406 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 21 09:36:24.914548 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-2df6e350-8565-4912-bc5c-b96a5608e775 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:36:24.915305 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-2df6e350-8565-4912-bc5c-b96a5608e775 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] [instance: 06ae865a-6ba5-4198-be6d-e6056e645411] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:36:24.921537 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-2df6e350-8565-4912-bc5c-b96a5608e775 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:24.922075 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-2df6e350-8565-4912-bc5c-b96a5608e775 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:24.922856 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-2df6e350-8565-4912-bc5c-b96a5608e775 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:24.923284 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-2df6e350-8565-4912-bc5c-b96a5608e775 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:25.088930 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-2df6e350-8565-4912-bc5c-b96a5608e775 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db87258db1424ce7a8399fdd05efe3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89d1b21ad8471a8a9a82adac2594c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:36:25.104116 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-2df6e350-8565-4912-bc5c-b96a5608e775 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] 10.222.0.45 "GET /compute/v2.1/servers/06ae865a-6ba5-4198-be6d-e6056e645411" status: 200 len: 1322 microversion: 2.1 time: 0.194199 Jan 21 09:36:25.105890 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 66/116] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:36:24 2022] GET /compute/v2.1/servers/06ae865a-6ba5-4198-be6d-e6056e645411 => generated 1322 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:36:25.240301 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-3098b662-7caf-46fd-918a-db1879c5e123 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:36:25.241823 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-3098b662-7caf-46fd-918a-db1879c5e123 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] [instance: 370b78d2-d154-4c93-b8ef-3723bd26c3d4] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:36:25.248173 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-3098b662-7caf-46fd-918a-db1879c5e123 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:25.248686 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-3098b662-7caf-46fd-918a-db1879c5e123 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:25.249573 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-3098b662-7caf-46fd-918a-db1879c5e123 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:25.250084 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-3098b662-7caf-46fd-918a-db1879c5e123 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:25.411279 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-3098b662-7caf-46fd-918a-db1879c5e123 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7b2c14d9444d65ab7a874e749671bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3390729231b409e9a83376b428c1a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:36:25.424520 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-3098b662-7caf-46fd-918a-db1879c5e123 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] 10.222.0.45 "GET /compute/v2.1/servers/370b78d2-d154-4c93-b8ef-3723bd26c3d4" status: 200 len: 1317 microversion: 2.1 time: 0.187707 Jan 21 09:36:25.425416 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 51/117] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:36:25 2022] GET /compute/v2.1/servers/370b78d2-d154-4c93-b8ef-3723bd26c3d4 => generated 1317 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 09:36:25.851523 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-7116fa0d-a99e-4edf-a481-1fd70743b116 tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:36:25.852160 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-7116fa0d-a99e-4edf-a481-1fd70743b116 tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] [instance: b50feb40-c691-4724-8570-f5873bdc5d1e] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:36:25.858515 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-7116fa0d-a99e-4edf-a481-1fd70743b116 tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:25.859149 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-7116fa0d-a99e-4edf-a481-1fd70743b116 tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:25.859938 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-7116fa0d-a99e-4edf-a481-1fd70743b116 tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:25.860371 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-7116fa0d-a99e-4edf-a481-1fd70743b116 tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:25.902746 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-84e3a42d-2be3-47bc-9d6a-1aee260433d8 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:36:25.903359 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-84e3a42d-2be3-47bc-9d6a-1aee260433d8 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] [instance: 59ad64a5-af93-44ef-8031-fd2f2d18a901] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:36:25.910356 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-84e3a42d-2be3-47bc-9d6a-1aee260433d8 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:25.910916 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-84e3a42d-2be3-47bc-9d6a-1aee260433d8 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:25.911897 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-84e3a42d-2be3-47bc-9d6a-1aee260433d8 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:25.913162 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-84e3a42d-2be3-47bc-9d6a-1aee260433d8 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:26.056425 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-7116fa0d-a99e-4edf-a481-1fd70743b116 tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b547a45bb54a8f94e9e5f5aeba7520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a31f7136c241578473d4d323722c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:36:26.064319 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-7116fa0d-a99e-4edf-a481-1fd70743b116 tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] 10.222.0.45 "GET /compute/v2.1/servers/b50feb40-c691-4724-8570-f5873bdc5d1e" status: 200 len: 1315 microversion: 2.1 time: 0.217885 Jan 21 09:36:26.076306 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 67/118] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:36:25 2022] GET /compute/v2.1/servers/b50feb40-c691-4724-8570-f5873bdc5d1e => generated 1315 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:36:26.124445 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-b8f62d1b-10ef-42d6-9b0a-5d877b06d979 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:36:26.125194 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-b8f62d1b-10ef-42d6-9b0a-5d877b06d979 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] [instance: 06ae865a-6ba5-4198-be6d-e6056e645411] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:36:26.134147 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-b8f62d1b-10ef-42d6-9b0a-5d877b06d979 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:26.134970 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-b8f62d1b-10ef-42d6-9b0a-5d877b06d979 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:26.136282 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-b8f62d1b-10ef-42d6-9b0a-5d877b06d979 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:26.136816 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-b8f62d1b-10ef-42d6-9b0a-5d877b06d979 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:26.139169 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-84e3a42d-2be3-47bc-9d6a-1aee260433d8 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:36:26.152331 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-84e3a42d-2be3-47bc-9d6a-1aee260433d8 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:36:26.154195 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-84e3a42d-2be3-47bc-9d6a-1aee260433d8 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:36:26.158225 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-84e3a42d-2be3-47bc-9d6a-1aee260433d8 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "GET /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901" status: 200 len: 1406 microversion: 2.20 time: 0.259100 Jan 21 09:36:26.163719 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 52/119] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jan 21 09:36:25 2022] GET /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901 => generated 1406 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 21 09:36:26.320016 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-b8f62d1b-10ef-42d6-9b0a-5d877b06d979 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db87258db1424ce7a8399fdd05efe3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89d1b21ad8471a8a9a82adac2594c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:36:26.327534 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-b8f62d1b-10ef-42d6-9b0a-5d877b06d979 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] 10.222.0.45 "GET /compute/v2.1/servers/06ae865a-6ba5-4198-be6d-e6056e645411" status: 200 len: 1322 microversion: 2.1 time: 0.206893 Jan 21 09:36:26.328098 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 68/120] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:36:26 2022] GET /compute/v2.1/servers/06ae865a-6ba5-4198-be6d-e6056e645411 => generated 1322 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 09:36:26.441790 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-702b30c4-5537-4f2f-ab1a-6e6bce542ecc tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:36:26.442403 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-702b30c4-5537-4f2f-ab1a-6e6bce542ecc tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] [instance: 370b78d2-d154-4c93-b8ef-3723bd26c3d4] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:36:26.448700 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-702b30c4-5537-4f2f-ab1a-6e6bce542ecc tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:26.449181 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-702b30c4-5537-4f2f-ab1a-6e6bce542ecc tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:26.449993 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-702b30c4-5537-4f2f-ab1a-6e6bce542ecc tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:26.450429 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-702b30c4-5537-4f2f-ab1a-6e6bce542ecc tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:26.647439 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-702b30c4-5537-4f2f-ab1a-6e6bce542ecc tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7b2c14d9444d65ab7a874e749671bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3390729231b409e9a83376b428c1a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:36:26.652878 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-702b30c4-5537-4f2f-ab1a-6e6bce542ecc tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] 10.222.0.45 "GET /compute/v2.1/servers/370b78d2-d154-4c93-b8ef-3723bd26c3d4" status: 200 len: 1317 microversion: 2.1 time: 0.214792 Jan 21 09:36:26.653772 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 53/121] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:36:26 2022] GET /compute/v2.1/servers/370b78d2-d154-4c93-b8ef-3723bd26c3d4 => generated 1317 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:36:27.082754 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-b7118264-64ad-4ba6-b46a-043dc30a8bd5 tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:36:27.083529 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-b7118264-64ad-4ba6-b46a-043dc30a8bd5 tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] [instance: b50feb40-c691-4724-8570-f5873bdc5d1e] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:36:27.090688 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-b7118264-64ad-4ba6-b46a-043dc30a8bd5 tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:27.091214 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-b7118264-64ad-4ba6-b46a-043dc30a8bd5 tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:27.092063 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-b7118264-64ad-4ba6-b46a-043dc30a8bd5 tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:27.092569 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-b7118264-64ad-4ba6-b46a-043dc30a8bd5 tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:27.180703 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-00c56e52-1d93-4079-95fa-eaf856579cef tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:36:27.181342 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-00c56e52-1d93-4079-95fa-eaf856579cef tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] [instance: 59ad64a5-af93-44ef-8031-fd2f2d18a901] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:36:27.187589 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-00c56e52-1d93-4079-95fa-eaf856579cef tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:27.188042 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-00c56e52-1d93-4079-95fa-eaf856579cef tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:27.188827 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-00c56e52-1d93-4079-95fa-eaf856579cef tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:27.189285 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-00c56e52-1d93-4079-95fa-eaf856579cef tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:27.291328 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-b7118264-64ad-4ba6-b46a-043dc30a8bd5 tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b547a45bb54a8f94e9e5f5aeba7520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a31f7136c241578473d4d323722c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:36:27.301341 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-b7118264-64ad-4ba6-b46a-043dc30a8bd5 tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] 10.222.0.45 "GET /compute/v2.1/servers/b50feb40-c691-4724-8570-f5873bdc5d1e" status: 200 len: 1315 microversion: 2.1 time: 0.222231 Jan 21 09:36:27.302396 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 69/122] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:36:27 2022] GET /compute/v2.1/servers/b50feb40-c691-4724-8570-f5873bdc5d1e => generated 1315 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:36:27.344241 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-1554f982-6a90-4b7c-ae8e-59c0b9c94296 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:36:27.344848 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-1554f982-6a90-4b7c-ae8e-59c0b9c94296 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] [instance: 06ae865a-6ba5-4198-be6d-e6056e645411] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:36:27.350808 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-1554f982-6a90-4b7c-ae8e-59c0b9c94296 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:27.351253 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-1554f982-6a90-4b7c-ae8e-59c0b9c94296 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:27.352091 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-1554f982-6a90-4b7c-ae8e-59c0b9c94296 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:27.352689 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-1554f982-6a90-4b7c-ae8e-59c0b9c94296 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:27.370560 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-00c56e52-1d93-4079-95fa-eaf856579cef tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:36:27.379440 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-00c56e52-1d93-4079-95fa-eaf856579cef tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:36:27.380966 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-00c56e52-1d93-4079-95fa-eaf856579cef tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:36:27.383054 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-00c56e52-1d93-4079-95fa-eaf856579cef tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "GET /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901" status: 200 len: 1406 microversion: 2.20 time: 0.206738 Jan 21 09:36:27.383936 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 54/123] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jan 21 09:36:27 2022] GET /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901 => generated 1406 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 21 09:36:27.499028 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-1554f982-6a90-4b7c-ae8e-59c0b9c94296 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db87258db1424ce7a8399fdd05efe3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89d1b21ad8471a8a9a82adac2594c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:36:27.507247 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-1554f982-6a90-4b7c-ae8e-59c0b9c94296 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] 10.222.0.45 "GET /compute/v2.1/servers/06ae865a-6ba5-4198-be6d-e6056e645411" status: 200 len: 1322 microversion: 2.1 time: 0.165905 Jan 21 09:36:27.507833 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 70/124] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:36:27 2022] GET /compute/v2.1/servers/06ae865a-6ba5-4198-be6d-e6056e645411 => generated 1322 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:36:27.670670 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-abac7347-57a5-433a-9fbe-123784aa9402 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:36:27.671551 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-abac7347-57a5-433a-9fbe-123784aa9402 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] [instance: 370b78d2-d154-4c93-b8ef-3723bd26c3d4] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:36:27.677644 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-abac7347-57a5-433a-9fbe-123784aa9402 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:27.678215 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-abac7347-57a5-433a-9fbe-123784aa9402 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:27.679057 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-abac7347-57a5-433a-9fbe-123784aa9402 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:27.679690 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-abac7347-57a5-433a-9fbe-123784aa9402 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:27.861943 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-abac7347-57a5-433a-9fbe-123784aa9402 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7b2c14d9444d65ab7a874e749671bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3390729231b409e9a83376b428c1a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:36:27.861943 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-abac7347-57a5-433a-9fbe-123784aa9402 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] 10.222.0.45 "GET /compute/v2.1/servers/370b78d2-d154-4c93-b8ef-3723bd26c3d4" status: 200 len: 1317 microversion: 2.1 time: 0.178804 Jan 21 09:36:27.861943 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 55/125] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:36:27 2022] GET /compute/v2.1/servers/370b78d2-d154-4c93-b8ef-3723bd26c3d4 => generated 1317 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:36:28.327768 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-898061b9-98aa-4f14-b7eb-43839c9eee1b tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:36:28.329280 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-898061b9-98aa-4f14-b7eb-43839c9eee1b tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] [instance: b50feb40-c691-4724-8570-f5873bdc5d1e] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:36:28.335611 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-898061b9-98aa-4f14-b7eb-43839c9eee1b tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:28.336062 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-898061b9-98aa-4f14-b7eb-43839c9eee1b tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:28.336851 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-898061b9-98aa-4f14-b7eb-43839c9eee1b tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:28.337318 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-898061b9-98aa-4f14-b7eb-43839c9eee1b tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:28.403740 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-3c3d7691-a410-490e-88d6-659ef26cd4c9 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:36:28.404355 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-3c3d7691-a410-490e-88d6-659ef26cd4c9 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] [instance: 59ad64a5-af93-44ef-8031-fd2f2d18a901] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:36:28.410670 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-3c3d7691-a410-490e-88d6-659ef26cd4c9 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:28.411587 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-3c3d7691-a410-490e-88d6-659ef26cd4c9 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:28.412466 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-3c3d7691-a410-490e-88d6-659ef26cd4c9 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:28.413318 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-3c3d7691-a410-490e-88d6-659ef26cd4c9 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:28.530210 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-898061b9-98aa-4f14-b7eb-43839c9eee1b tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b547a45bb54a8f94e9e5f5aeba7520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a31f7136c241578473d4d323722c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:36:28.540057 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-898061b9-98aa-4f14-b7eb-43839c9eee1b tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] 10.222.0.45 "GET /compute/v2.1/servers/b50feb40-c691-4724-8570-f5873bdc5d1e" status: 200 len: 1315 microversion: 2.1 time: 0.215896 Jan 21 09:36:28.541719 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 71/126] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:36:28 2022] GET /compute/v2.1/servers/b50feb40-c691-4724-8570-f5873bdc5d1e => generated 1315 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 09:36:28.547965 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-cce2200a-022c-4b38-8408-fbd5ed026b85 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:36:28.552577 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-cce2200a-022c-4b38-8408-fbd5ed026b85 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] [instance: 06ae865a-6ba5-4198-be6d-e6056e645411] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:36:28.565669 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-cce2200a-022c-4b38-8408-fbd5ed026b85 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:28.568028 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-cce2200a-022c-4b38-8408-fbd5ed026b85 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:28.568028 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-cce2200a-022c-4b38-8408-fbd5ed026b85 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:28.568028 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-cce2200a-022c-4b38-8408-fbd5ed026b85 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:28.631977 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-3c3d7691-a410-490e-88d6-659ef26cd4c9 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:36:28.664749 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-3c3d7691-a410-490e-88d6-659ef26cd4c9 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:36:28.666957 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-3c3d7691-a410-490e-88d6-659ef26cd4c9 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:36:28.671210 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-3c3d7691-a410-490e-88d6-659ef26cd4c9 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "GET /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901" status: 200 len: 1406 microversion: 2.20 time: 0.269433 Jan 21 09:36:28.673463 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 56/127] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jan 21 09:36:28 2022] GET /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901 => generated 1406 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 21 09:36:28.776960 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-cce2200a-022c-4b38-8408-fbd5ed026b85 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db87258db1424ce7a8399fdd05efe3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89d1b21ad8471a8a9a82adac2594c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:36:28.800860 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-cce2200a-022c-4b38-8408-fbd5ed026b85 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] 10.222.0.45 "GET /compute/v2.1/servers/06ae865a-6ba5-4198-be6d-e6056e645411" status: 200 len: 1322 microversion: 2.1 time: 0.250555 Jan 21 09:36:28.800860 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 72/128] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:36:28 2022] GET /compute/v2.1/servers/06ae865a-6ba5-4198-be6d-e6056e645411 => generated 1322 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:36:28.879044 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-94435af0-261c-4303-8385-64e148342301 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:36:28.880281 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-94435af0-261c-4303-8385-64e148342301 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] [instance: 370b78d2-d154-4c93-b8ef-3723bd26c3d4] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:36:28.889333 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-94435af0-261c-4303-8385-64e148342301 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:28.889810 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-94435af0-261c-4303-8385-64e148342301 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:28.890827 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-94435af0-261c-4303-8385-64e148342301 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:28.891440 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-94435af0-261c-4303-8385-64e148342301 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:29.050172 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-94435af0-261c-4303-8385-64e148342301 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7b2c14d9444d65ab7a874e749671bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3390729231b409e9a83376b428c1a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:36:29.058117 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-94435af0-261c-4303-8385-64e148342301 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] 10.222.0.45 "GET /compute/v2.1/servers/370b78d2-d154-4c93-b8ef-3723bd26c3d4" status: 200 len: 1317 microversion: 2.1 time: 0.183865 Jan 21 09:36:29.058738 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 57/129] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:36:28 2022] GET /compute/v2.1/servers/370b78d2-d154-4c93-b8ef-3723bd26c3d4 => generated 1317 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:36:29.557592 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-87a3215b-88d4-40bd-b24f-7caea483a220 tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:36:29.560469 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-87a3215b-88d4-40bd-b24f-7caea483a220 tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] [instance: b50feb40-c691-4724-8570-f5873bdc5d1e] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:36:29.564212 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-87a3215b-88d4-40bd-b24f-7caea483a220 tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:29.564660 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-87a3215b-88d4-40bd-b24f-7caea483a220 tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:29.565461 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-87a3215b-88d4-40bd-b24f-7caea483a220 tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:29.565894 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-87a3215b-88d4-40bd-b24f-7caea483a220 tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:29.695802 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-88c01e9e-5b67-4937-a909-86189b3d29fb tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:36:29.696532 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-88c01e9e-5b67-4937-a909-86189b3d29fb tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] [instance: 59ad64a5-af93-44ef-8031-fd2f2d18a901] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:36:29.708837 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-87a3215b-88d4-40bd-b24f-7caea483a220 tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b547a45bb54a8f94e9e5f5aeba7520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a31f7136c241578473d4d323722c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:36:29.719316 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-88c01e9e-5b67-4937-a909-86189b3d29fb tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:29.720592 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-88c01e9e-5b67-4937-a909-86189b3d29fb tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:29.720779 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-87a3215b-88d4-40bd-b24f-7caea483a220 tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] 10.222.0.45 "GET /compute/v2.1/servers/b50feb40-c691-4724-8570-f5873bdc5d1e" status: 200 len: 1315 microversion: 2.1 time: 0.167207 Jan 21 09:36:29.721756 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 73/130] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:36:29 2022] GET /compute/v2.1/servers/b50feb40-c691-4724-8570-f5873bdc5d1e => generated 1315 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:36:29.727145 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-88c01e9e-5b67-4937-a909-86189b3d29fb tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:29.727145 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-88c01e9e-5b67-4937-a909-86189b3d29fb tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:29.813360 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-fe070d77-d0a5-480d-99ae-9f7d1254bfda tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:36:29.814267 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-fe070d77-d0a5-480d-99ae-9f7d1254bfda tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] [instance: 06ae865a-6ba5-4198-be6d-e6056e645411] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:36:29.823153 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-fe070d77-d0a5-480d-99ae-9f7d1254bfda tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:29.830161 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-fe070d77-d0a5-480d-99ae-9f7d1254bfda tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:29.831689 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-fe070d77-d0a5-480d-99ae-9f7d1254bfda tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:29.838236 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-fe070d77-d0a5-480d-99ae-9f7d1254bfda tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:29.917638 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-88c01e9e-5b67-4937-a909-86189b3d29fb tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:36:29.928581 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-88c01e9e-5b67-4937-a909-86189b3d29fb tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:36:29.930792 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-88c01e9e-5b67-4937-a909-86189b3d29fb tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:36:29.933261 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-88c01e9e-5b67-4937-a909-86189b3d29fb tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "GET /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901" status: 200 len: 1406 microversion: 2.20 time: 0.243401 Jan 21 09:36:29.934563 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 58/131] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jan 21 09:36:29 2022] GET /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901 => generated 1406 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 21 09:36:30.025188 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-fe070d77-d0a5-480d-99ae-9f7d1254bfda tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db87258db1424ce7a8399fdd05efe3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89d1b21ad8471a8a9a82adac2594c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:36:30.032385 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-fe070d77-d0a5-480d-99ae-9f7d1254bfda tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] 10.222.0.45 "GET /compute/v2.1/servers/06ae865a-6ba5-4198-be6d-e6056e645411" status: 200 len: 1322 microversion: 2.1 time: 0.222835 Jan 21 09:36:30.032993 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 74/132] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:36:29 2022] GET /compute/v2.1/servers/06ae865a-6ba5-4198-be6d-e6056e645411 => generated 1322 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:36:30.076066 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-01121960-e03b-47ba-beae-d9b1d4f88b66 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:36:30.077033 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-01121960-e03b-47ba-beae-d9b1d4f88b66 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] [instance: 370b78d2-d154-4c93-b8ef-3723bd26c3d4] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:36:30.084788 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-01121960-e03b-47ba-beae-d9b1d4f88b66 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:30.084788 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-01121960-e03b-47ba-beae-d9b1d4f88b66 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:30.085233 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-01121960-e03b-47ba-beae-d9b1d4f88b66 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:30.085837 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-01121960-e03b-47ba-beae-d9b1d4f88b66 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:30.221772 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-01121960-e03b-47ba-beae-d9b1d4f88b66 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7b2c14d9444d65ab7a874e749671bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3390729231b409e9a83376b428c1a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:36:30.229609 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-01121960-e03b-47ba-beae-d9b1d4f88b66 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] 10.222.0.45 "GET /compute/v2.1/servers/370b78d2-d154-4c93-b8ef-3723bd26c3d4" status: 200 len: 1317 microversion: 2.1 time: 0.157102 Jan 21 09:36:30.230182 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 59/133] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:36:30 2022] GET /compute/v2.1/servers/370b78d2-d154-4c93-b8ef-3723bd26c3d4 => generated 1317 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:36:30.752950 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-23c71de4-a08d-4d11-9604-0d225ca6bf56 tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:36:30.757951 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-23c71de4-a08d-4d11-9604-0d225ca6bf56 tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] [instance: b50feb40-c691-4724-8570-f5873bdc5d1e] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:36:30.766388 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-23c71de4-a08d-4d11-9604-0d225ca6bf56 tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:30.766839 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-23c71de4-a08d-4d11-9604-0d225ca6bf56 tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:30.767871 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-23c71de4-a08d-4d11-9604-0d225ca6bf56 tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:30.768248 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-23c71de4-a08d-4d11-9604-0d225ca6bf56 tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:30.953820 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-aff63d9d-35df-4930-bd47-eb7d821dc59e tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:36:30.955054 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-aff63d9d-35df-4930-bd47-eb7d821dc59e tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] [instance: 59ad64a5-af93-44ef-8031-fd2f2d18a901] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:36:30.970887 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-aff63d9d-35df-4930-bd47-eb7d821dc59e tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:30.974456 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-23c71de4-a08d-4d11-9604-0d225ca6bf56 tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b547a45bb54a8f94e9e5f5aeba7520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a31f7136c241578473d4d323722c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:36:30.974733 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-aff63d9d-35df-4930-bd47-eb7d821dc59e tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:30.976171 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-aff63d9d-35df-4930-bd47-eb7d821dc59e tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:30.976628 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-aff63d9d-35df-4930-bd47-eb7d821dc59e tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:30.986660 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-23c71de4-a08d-4d11-9604-0d225ca6bf56 tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] 10.222.0.45 "GET /compute/v2.1/servers/b50feb40-c691-4724-8570-f5873bdc5d1e" status: 200 len: 1315 microversion: 2.1 time: 0.238464 Jan 21 09:36:31.002105 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 75/134] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:36:30 2022] GET /compute/v2.1/servers/b50feb40-c691-4724-8570-f5873bdc5d1e => generated 1315 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:36:31.049466 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-96813031-b187-427d-9538-0fb7afe80576 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:36:31.050468 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-96813031-b187-427d-9538-0fb7afe80576 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] [instance: 06ae865a-6ba5-4198-be6d-e6056e645411] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:36:31.058346 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-96813031-b187-427d-9538-0fb7afe80576 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:31.059031 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-96813031-b187-427d-9538-0fb7afe80576 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:31.061000 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-96813031-b187-427d-9538-0fb7afe80576 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:31.062151 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-96813031-b187-427d-9538-0fb7afe80576 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:31.179614 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-aff63d9d-35df-4930-bd47-eb7d821dc59e tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:36:31.190688 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-aff63d9d-35df-4930-bd47-eb7d821dc59e tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:36:31.194644 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-aff63d9d-35df-4930-bd47-eb7d821dc59e tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:36:31.196878 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-aff63d9d-35df-4930-bd47-eb7d821dc59e tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "GET /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901" status: 200 len: 1406 microversion: 2.20 time: 0.247172 Jan 21 09:36:31.198319 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 60/135] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jan 21 09:36:30 2022] GET /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901 => generated 1406 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 21 09:36:31.246229 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-973f00a2-53db-46cd-ba4a-bacb6ff0ab70 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:36:31.246777 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-973f00a2-53db-46cd-ba4a-bacb6ff0ab70 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] [instance: 370b78d2-d154-4c93-b8ef-3723bd26c3d4] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:36:31.248681 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-96813031-b187-427d-9538-0fb7afe80576 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db87258db1424ce7a8399fdd05efe3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89d1b21ad8471a8a9a82adac2594c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:36:31.258029 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-973f00a2-53db-46cd-ba4a-bacb6ff0ab70 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:31.258490 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-973f00a2-53db-46cd-ba4a-bacb6ff0ab70 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:31.259299 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-973f00a2-53db-46cd-ba4a-bacb6ff0ab70 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:31.259732 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-973f00a2-53db-46cd-ba4a-bacb6ff0ab70 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:31.262639 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-96813031-b187-427d-9538-0fb7afe80576 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] 10.222.0.45 "GET /compute/v2.1/servers/06ae865a-6ba5-4198-be6d-e6056e645411" status: 200 len: 1322 microversion: 2.1 time: 0.216552 Jan 21 09:36:31.274225 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 76/136] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:36:31 2022] GET /compute/v2.1/servers/06ae865a-6ba5-4198-be6d-e6056e645411 => generated 1322 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 09:36:31.442052 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-973f00a2-53db-46cd-ba4a-bacb6ff0ab70 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7b2c14d9444d65ab7a874e749671bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3390729231b409e9a83376b428c1a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:36:31.451821 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-973f00a2-53db-46cd-ba4a-bacb6ff0ab70 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] 10.222.0.45 "GET /compute/v2.1/servers/370b78d2-d154-4c93-b8ef-3723bd26c3d4" status: 200 len: 1317 microversion: 2.1 time: 0.209054 Jan 21 09:36:31.452409 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 61/137] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:36:31 2022] GET /compute/v2.1/servers/370b78d2-d154-4c93-b8ef-3723bd26c3d4 => generated 1317 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 09:36:31.606748 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [req-8858d98e-fe69-4888-8cd3-dd36e4413f0e req-46af62fc-7e4c-4a81-913f-5066cbe7d95c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06ae865a-6ba5-4198-be6d-e6056e645411", "name": "network-vif-plugged", "status": "completed", "tag": "2b16cf8c-7e83-4177-a9ae-f7516c48e617"}]} {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:36:31.609072 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 21 09:36:31.609072 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: warnings.warn(msg) Jan 21 09:36:31.623760 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [req-8858d98e-fe69-4888-8cd3-dd36e4413f0e req-46af62fc-7e4c-4a81-913f-5066cbe7d95c service nova] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:31.624209 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [req-8858d98e-fe69-4888-8cd3-dd36e4413f0e req-46af62fc-7e4c-4a81-913f-5066cbe7d95c service nova] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:31.664705 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.compute.server_external_events [req-8858d98e-fe69-4888-8cd3-dd36e4413f0e req-46af62fc-7e4c-4a81-913f-5066cbe7d95c service nova] Creating event network-vif-plugged:2b16cf8c-7e83-4177-a9ae-f7516c48e617 for instance 06ae865a-6ba5-4198-be6d-e6056e645411 on hv-cinder-80403 Jan 21 09:36:31.672864 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [req-8858d98e-fe69-4888-8cd3-dd36e4413f0e req-46af62fc-7e4c-4a81-913f-5066cbe7d95c service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.159119 Jan 21 09:36:31.675218 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 77/138] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Jan 21 09:36:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 09:36:32.018414 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-9a1d528f-501f-4e5f-adb7-866a940e7a2c tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:36:32.018414 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-9a1d528f-501f-4e5f-adb7-866a940e7a2c tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] [instance: b50feb40-c691-4724-8570-f5873bdc5d1e] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:36:32.021076 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-9a1d528f-501f-4e5f-adb7-866a940e7a2c tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:32.022306 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-9a1d528f-501f-4e5f-adb7-866a940e7a2c tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:32.023301 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-9a1d528f-501f-4e5f-adb7-866a940e7a2c tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:32.023950 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-9a1d528f-501f-4e5f-adb7-866a940e7a2c tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:32.196581 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-9a1d528f-501f-4e5f-adb7-866a940e7a2c tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b547a45bb54a8f94e9e5f5aeba7520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a31f7136c241578473d4d323722c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:36:32.205235 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-9a1d528f-501f-4e5f-adb7-866a940e7a2c tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] 10.222.0.45 "GET /compute/v2.1/servers/b50feb40-c691-4724-8570-f5873bdc5d1e" status: 200 len: 1315 microversion: 2.1 time: 0.197412 Jan 21 09:36:32.205936 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 62/139] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:36:32 2022] GET /compute/v2.1/servers/b50feb40-c691-4724-8570-f5873bdc5d1e => generated 1315 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:36:32.219100 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-b39186b9-4815-449b-8477-45a54e4714bf tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:36:32.219565 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-b39186b9-4815-449b-8477-45a54e4714bf tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] [instance: 59ad64a5-af93-44ef-8031-fd2f2d18a901] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:36:32.226395 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-b39186b9-4815-449b-8477-45a54e4714bf tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:32.226852 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-b39186b9-4815-449b-8477-45a54e4714bf tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:32.227648 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-b39186b9-4815-449b-8477-45a54e4714bf tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:32.228276 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-b39186b9-4815-449b-8477-45a54e4714bf tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:32.280129 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-33abc58e-1f17-41fc-9450-4d9183b51280 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:36:32.280737 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-33abc58e-1f17-41fc-9450-4d9183b51280 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] [instance: 06ae865a-6ba5-4198-be6d-e6056e645411] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:36:32.289304 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-33abc58e-1f17-41fc-9450-4d9183b51280 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:32.289768 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-33abc58e-1f17-41fc-9450-4d9183b51280 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:32.290580 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-33abc58e-1f17-41fc-9450-4d9183b51280 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:32.291018 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-33abc58e-1f17-41fc-9450-4d9183b51280 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:32.413705 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-b39186b9-4815-449b-8477-45a54e4714bf tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:36:32.423072 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-b39186b9-4815-449b-8477-45a54e4714bf tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:36:32.425377 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-b39186b9-4815-449b-8477-45a54e4714bf tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:36:32.426827 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-b39186b9-4815-449b-8477-45a54e4714bf tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "GET /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901" status: 200 len: 1406 microversion: 2.20 time: 0.214668 Jan 21 09:36:32.438469 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 78/140] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jan 21 09:36:32 2022] GET /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901 => generated 1406 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 21 09:36:32.471308 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-a7c35a55-8278-454b-a5c8-50b9c5f99bc2 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:36:32.472367 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-a7c35a55-8278-454b-a5c8-50b9c5f99bc2 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] [instance: 370b78d2-d154-4c93-b8ef-3723bd26c3d4] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:36:32.484736 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-a7c35a55-8278-454b-a5c8-50b9c5f99bc2 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:32.488588 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-a7c35a55-8278-454b-a5c8-50b9c5f99bc2 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:32.489439 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-a7c35a55-8278-454b-a5c8-50b9c5f99bc2 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:32.489881 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-a7c35a55-8278-454b-a5c8-50b9c5f99bc2 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:32.503759 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-33abc58e-1f17-41fc-9450-4d9183b51280 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db87258db1424ce7a8399fdd05efe3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89d1b21ad8471a8a9a82adac2594c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:36:32.513405 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-33abc58e-1f17-41fc-9450-4d9183b51280 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] 10.222.0.45 "GET /compute/v2.1/servers/06ae865a-6ba5-4198-be6d-e6056e645411" status: 200 len: 1322 microversion: 2.1 time: 0.237180 Jan 21 09:36:32.515099 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 63/141] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:36:32 2022] GET /compute/v2.1/servers/06ae865a-6ba5-4198-be6d-e6056e645411 => generated 1322 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:36:32.673452 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-a7c35a55-8278-454b-a5c8-50b9c5f99bc2 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7b2c14d9444d65ab7a874e749671bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3390729231b409e9a83376b428c1a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:36:32.683084 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-a7c35a55-8278-454b-a5c8-50b9c5f99bc2 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] 10.222.0.45 "GET /compute/v2.1/servers/370b78d2-d154-4c93-b8ef-3723bd26c3d4" status: 200 len: 1317 microversion: 2.1 time: 0.217401 Jan 21 09:36:32.683736 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 79/142] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:36:32 2022] GET /compute/v2.1/servers/370b78d2-d154-4c93-b8ef-3723bd26c3d4 => generated 1317 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 09:36:33.223277 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-8e2bc9bc-fd0b-486b-bc8e-f0150916b9a3 tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:36:33.224137 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-8e2bc9bc-fd0b-486b-bc8e-f0150916b9a3 tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] [instance: b50feb40-c691-4724-8570-f5873bdc5d1e] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:36:33.230880 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-8e2bc9bc-fd0b-486b-bc8e-f0150916b9a3 tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:33.231333 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-8e2bc9bc-fd0b-486b-bc8e-f0150916b9a3 tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:33.232111 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-8e2bc9bc-fd0b-486b-bc8e-f0150916b9a3 tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:33.232544 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-8e2bc9bc-fd0b-486b-bc8e-f0150916b9a3 tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:33.390261 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-8e2bc9bc-fd0b-486b-bc8e-f0150916b9a3 tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b547a45bb54a8f94e9e5f5aeba7520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a31f7136c241578473d4d323722c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:36:33.409642 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-8e2bc9bc-fd0b-486b-bc8e-f0150916b9a3 tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] 10.222.0.45 "GET /compute/v2.1/servers/b50feb40-c691-4724-8570-f5873bdc5d1e" status: 200 len: 1315 microversion: 2.1 time: 0.189918 Jan 21 09:36:33.411410 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 64/143] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:36:33 2022] GET /compute/v2.1/servers/b50feb40-c691-4724-8570-f5873bdc5d1e => generated 1315 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:36:33.454660 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-f438566e-dd1e-4810-abcc-aa68a9094873 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:36:33.455245 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-f438566e-dd1e-4810-abcc-aa68a9094873 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] [instance: 59ad64a5-af93-44ef-8031-fd2f2d18a901] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:36:33.462231 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-f438566e-dd1e-4810-abcc-aa68a9094873 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:33.462676 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-f438566e-dd1e-4810-abcc-aa68a9094873 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:33.463456 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-f438566e-dd1e-4810-abcc-aa68a9094873 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:33.463891 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-f438566e-dd1e-4810-abcc-aa68a9094873 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:33.531458 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-95b3928e-e410-4832-bdd5-ed33aca61cb2 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:36:33.532059 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-95b3928e-e410-4832-bdd5-ed33aca61cb2 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] [instance: 06ae865a-6ba5-4198-be6d-e6056e645411] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:36:33.540731 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-95b3928e-e410-4832-bdd5-ed33aca61cb2 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:33.541280 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-95b3928e-e410-4832-bdd5-ed33aca61cb2 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:33.542358 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-95b3928e-e410-4832-bdd5-ed33aca61cb2 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:33.542848 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-95b3928e-e410-4832-bdd5-ed33aca61cb2 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:33.659826 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-f438566e-dd1e-4810-abcc-aa68a9094873 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:36:33.676351 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-f438566e-dd1e-4810-abcc-aa68a9094873 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:36:33.683330 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-f438566e-dd1e-4810-abcc-aa68a9094873 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:36:33.692006 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-f438566e-dd1e-4810-abcc-aa68a9094873 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "GET /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901" status: 200 len: 1406 microversion: 2.20 time: 0.240962 Jan 21 09:36:33.703668 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 80/144] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jan 21 09:36:33 2022] GET /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901 => generated 1406 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 21 09:36:33.708661 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [req-d13f5fec-fc1d-416a-93c5-f36489f90117 req-f02fb030-4a03-4512-8b0e-317bbcbb9ee6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e67b25e-7e65-4975-bafa-fceafcd53647", "name": "network-vif-plugged", "status": "completed", "tag": "9eccc2a4-ddb6-4675-9f12-63953114fa21"}, {"server_uuid": "370b78d2-d154-4c93-b8ef-3723bd26c3d4", "name": "network-vif-plugged", "status": "completed", "tag": "af30d40e-e03c-4e1e-a789-41a34ac8bec6"}, {"server_uuid": "b50feb40-c691-4724-8570-f5873bdc5d1e", "name": "network-vif-plugged", "status": "completed", "tag": "dde72027-8017-427e-a871-c6be683d8168"}, {"server_uuid": "59ad64a5-af93-44ef-8031-fd2f2d18a901", "name": "network-vif-plugged", "status": "completed", "tag": "63990fa3-fce3-4891-adb2-cd4ebc4c075a"}]} {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:36:33.712249 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 21 09:36:33.712249 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: warnings.warn(msg) Jan 21 09:36:33.720834 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [req-d13f5fec-fc1d-416a-93c5-f36489f90117 req-f02fb030-4a03-4512-8b0e-317bbcbb9ee6 service nova] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:33.721341 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [req-d13f5fec-fc1d-416a-93c5-f36489f90117 req-f02fb030-4a03-4512-8b0e-317bbcbb9ee6 service nova] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:33.730957 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-95b3928e-e410-4832-bdd5-ed33aca61cb2 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db87258db1424ce7a8399fdd05efe3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89d1b21ad8471a8a9a82adac2594c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:36:33.737016 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.compute.server_external_events [req-d13f5fec-fc1d-416a-93c5-f36489f90117 req-f02fb030-4a03-4512-8b0e-317bbcbb9ee6 service nova] Creating event network-vif-plugged:9eccc2a4-ddb6-4675-9f12-63953114fa21 for instance 4e67b25e-7e65-4975-bafa-fceafcd53647 on hv-cinder-80403 Jan 21 09:36:33.745074 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.compute.server_external_events [req-d13f5fec-fc1d-416a-93c5-f36489f90117 req-f02fb030-4a03-4512-8b0e-317bbcbb9ee6 service nova] Creating event network-vif-plugged:af30d40e-e03c-4e1e-a789-41a34ac8bec6 for instance 370b78d2-d154-4c93-b8ef-3723bd26c3d4 on hv-cinder-80403 Jan 21 09:36:33.745074 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.compute.server_external_events [req-d13f5fec-fc1d-416a-93c5-f36489f90117 req-f02fb030-4a03-4512-8b0e-317bbcbb9ee6 service nova] Creating event network-vif-plugged:dde72027-8017-427e-a871-c6be683d8168 for instance b50feb40-c691-4724-8570-f5873bdc5d1e on hv-cinder-80403 Jan 21 09:36:33.745323 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-95b3928e-e410-4832-bdd5-ed33aca61cb2 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] 10.222.0.45 "GET /compute/v2.1/servers/06ae865a-6ba5-4198-be6d-e6056e645411" status: 200 len: 1322 microversion: 2.1 time: 0.210879 Jan 21 09:36:33.745407 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.compute.server_external_events [req-d13f5fec-fc1d-416a-93c5-f36489f90117 req-f02fb030-4a03-4512-8b0e-317bbcbb9ee6 service nova] Creating event network-vif-plugged:63990fa3-fce3-4891-adb2-cd4ebc4c075a for instance 59ad64a5-af93-44ef-8031-fd2f2d18a901 on hv-cinder-80403 Jan 21 09:36:33.745477 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 65/145] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:36:33 2022] GET /compute/v2.1/servers/06ae865a-6ba5-4198-be6d-e6056e645411 => generated 1322 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 09:36:33.745477 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-d8562daf-f3dc-468a-8501-c2662c4692fd tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:36:33.745477 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-d8562daf-f3dc-468a-8501-c2662c4692fd tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] [instance: 370b78d2-d154-4c93-b8ef-3723bd26c3d4] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:36:33.750510 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [req-d13f5fec-fc1d-416a-93c5-f36489f90117 req-f02fb030-4a03-4512-8b0e-317bbcbb9ee6 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 696 microversion: 2.1 time: 0.045375 Jan 21 09:36:33.751116 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 81/146] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Jan 21 09:36:33 2022] POST /compute/v2.1/os-server-external-events => generated 696 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 09:36:33.751416 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-d8562daf-f3dc-468a-8501-c2662c4692fd tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:33.752001 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-d8562daf-f3dc-468a-8501-c2662c4692fd tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:33.752787 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-d8562daf-f3dc-468a-8501-c2662c4692fd tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:33.753595 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-d8562daf-f3dc-468a-8501-c2662c4692fd tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:33.940937 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-d8562daf-f3dc-468a-8501-c2662c4692fd tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7b2c14d9444d65ab7a874e749671bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3390729231b409e9a83376b428c1a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:36:33.951669 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-d8562daf-f3dc-468a-8501-c2662c4692fd tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] 10.222.0.45 "GET /compute/v2.1/servers/370b78d2-d154-4c93-b8ef-3723bd26c3d4" status: 200 len: 1317 microversion: 2.1 time: 0.211309 Jan 21 09:36:33.952571 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 66/147] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:36:33 2022] GET /compute/v2.1/servers/370b78d2-d154-4c93-b8ef-3723bd26c3d4 => generated 1317 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:36:34.434284 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-3801b055-03de-405c-acc7-aaf7f8cfc1f5 tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:36:34.435320 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-3801b055-03de-405c-acc7-aaf7f8cfc1f5 tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] [instance: b50feb40-c691-4724-8570-f5873bdc5d1e] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:36:34.448192 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-3801b055-03de-405c-acc7-aaf7f8cfc1f5 tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:34.448723 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-3801b055-03de-405c-acc7-aaf7f8cfc1f5 tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:34.450356 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-3801b055-03de-405c-acc7-aaf7f8cfc1f5 tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:34.450792 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-3801b055-03de-405c-acc7-aaf7f8cfc1f5 tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:34.679321 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-3801b055-03de-405c-acc7-aaf7f8cfc1f5 tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b547a45bb54a8f94e9e5f5aeba7520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a31f7136c241578473d4d323722c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:36:34.686831 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-3801b055-03de-405c-acc7-aaf7f8cfc1f5 tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] 10.222.0.45 "GET /compute/v2.1/servers/b50feb40-c691-4724-8570-f5873bdc5d1e" status: 200 len: 1315 microversion: 2.1 time: 0.256974 Jan 21 09:36:34.687437 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 82/148] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:36:34 2022] GET /compute/v2.1/servers/b50feb40-c691-4724-8570-f5873bdc5d1e => generated 1315 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:36:34.713000 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-2376ba54-e2d6-4f1a-a24f-5353cf015287 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:36:34.713812 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-2376ba54-e2d6-4f1a-a24f-5353cf015287 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] [instance: 59ad64a5-af93-44ef-8031-fd2f2d18a901] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:36:34.720357 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-2376ba54-e2d6-4f1a-a24f-5353cf015287 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:34.720790 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-2376ba54-e2d6-4f1a-a24f-5353cf015287 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:34.721684 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-2376ba54-e2d6-4f1a-a24f-5353cf015287 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:34.722173 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-2376ba54-e2d6-4f1a-a24f-5353cf015287 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:34.758460 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-3d5d585b-e896-489b-8ee1-62aebd575800 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:36:34.759620 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-3d5d585b-e896-489b-8ee1-62aebd575800 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] [instance: 06ae865a-6ba5-4198-be6d-e6056e645411] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:36:34.765853 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-3d5d585b-e896-489b-8ee1-62aebd575800 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:34.766293 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-3d5d585b-e896-489b-8ee1-62aebd575800 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:34.767095 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-3d5d585b-e896-489b-8ee1-62aebd575800 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:34.767525 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-3d5d585b-e896-489b-8ee1-62aebd575800 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:34.901097 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-2376ba54-e2d6-4f1a-a24f-5353cf015287 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:36:34.913188 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-2376ba54-e2d6-4f1a-a24f-5353cf015287 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:36:34.915516 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-2376ba54-e2d6-4f1a-a24f-5353cf015287 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:36:34.917455 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-2376ba54-e2d6-4f1a-a24f-5353cf015287 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "GET /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901" status: 200 len: 1406 microversion: 2.20 time: 0.209833 Jan 21 09:36:34.918830 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 67/149] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jan 21 09:36:34 2022] GET /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901 => generated 1406 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 21 09:36:34.969136 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-6d6e0506-3fb7-4ca1-8e2a-54042145f2ed tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:36:34.969974 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-6d6e0506-3fb7-4ca1-8e2a-54042145f2ed tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] [instance: 370b78d2-d154-4c93-b8ef-3723bd26c3d4] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:36:34.985056 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-6d6e0506-3fb7-4ca1-8e2a-54042145f2ed tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:34.985056 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-6d6e0506-3fb7-4ca1-8e2a-54042145f2ed tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:34.985056 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-6d6e0506-3fb7-4ca1-8e2a-54042145f2ed tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:34.985056 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-6d6e0506-3fb7-4ca1-8e2a-54042145f2ed tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:34.986256 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-3d5d585b-e896-489b-8ee1-62aebd575800 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db87258db1424ce7a8399fdd05efe3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89d1b21ad8471a8a9a82adac2594c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:36:34.995034 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-3d5d585b-e896-489b-8ee1-62aebd575800 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] 10.222.0.45 "GET /compute/v2.1/servers/06ae865a-6ba5-4198-be6d-e6056e645411" status: 200 len: 1516 microversion: 2.1 time: 0.240559 Jan 21 09:36:34.997930 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 83/150] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:36:34 2022] GET /compute/v2.1/servers/06ae865a-6ba5-4198-be6d-e6056e645411 => generated 1516 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 09:36:35.013910 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-64bd443d-7860-4809-a3f2-43f680257828 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:36:35.013910 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-64bd443d-7860-4809-a3f2-43f680257828 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] [instance: 06ae865a-6ba5-4198-be6d-e6056e645411] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:36:35.025596 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-64bd443d-7860-4809-a3f2-43f680257828 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:35.026047 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-64bd443d-7860-4809-a3f2-43f680257828 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:35.026828 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-64bd443d-7860-4809-a3f2-43f680257828 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:35.028802 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-64bd443d-7860-4809-a3f2-43f680257828 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:35.124347 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.objects.instance [None req-64bd443d-7860-4809-a3f2-43f680257828 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lazy-loading 'flavor' on Instance uuid 06ae865a-6ba5-4198-be6d-e6056e645411 {{(pid=123387) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 21 09:36:35.198823 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-6d6e0506-3fb7-4ca1-8e2a-54042145f2ed tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7b2c14d9444d65ab7a874e749671bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3390729231b409e9a83376b428c1a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:36:35.207013 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-6d6e0506-3fb7-4ca1-8e2a-54042145f2ed tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] 10.222.0.45 "GET /compute/v2.1/servers/370b78d2-d154-4c93-b8ef-3723bd26c3d4" status: 200 len: 1317 microversion: 2.1 time: 0.241297 Jan 21 09:36:35.208125 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 68/151] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:36:34 2022] GET /compute/v2.1/servers/370b78d2-d154-4c93-b8ef-3723bd26c3d4 => generated 1317 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 09:36:35.552119 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-64bd443d-7860-4809-a3f2-43f680257828 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] 10.222.0.45 "POST /compute/v2.1/servers/06ae865a-6ba5-4198-be6d-e6056e645411/action" status: 200 len: 32 microversion: 2.1 time: 0.543761 Jan 21 09:36:35.552893 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 84/152] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Jan 21 09:36:35 2022] POST /compute/v2.1/servers/06ae865a-6ba5-4198-be6d-e6056e645411/action => generated 32 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jan 21 09:36:35.562487 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-bf5483bf-cbbd-4665-aad9-8dc15f5c7ba7 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:36:35.563104 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-bf5483bf-cbbd-4665-aad9-8dc15f5c7ba7 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] [instance: 06ae865a-6ba5-4198-be6d-e6056e645411] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:36:35.569504 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-bf5483bf-cbbd-4665-aad9-8dc15f5c7ba7 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:35.570395 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-bf5483bf-cbbd-4665-aad9-8dc15f5c7ba7 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:35.571205 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-bf5483bf-cbbd-4665-aad9-8dc15f5c7ba7 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:35.575192 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-bf5483bf-cbbd-4665-aad9-8dc15f5c7ba7 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:35.718608 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-6ca6cf57-e7e2-4f98-80c5-0a6f97bcf11a tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:36:35.720031 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-6ca6cf57-e7e2-4f98-80c5-0a6f97bcf11a tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] [instance: b50feb40-c691-4724-8570-f5873bdc5d1e] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:36:35.727346 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-6ca6cf57-e7e2-4f98-80c5-0a6f97bcf11a tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:35.728034 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-6ca6cf57-e7e2-4f98-80c5-0a6f97bcf11a tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:35.728822 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-6ca6cf57-e7e2-4f98-80c5-0a6f97bcf11a tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:35.729395 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-6ca6cf57-e7e2-4f98-80c5-0a6f97bcf11a tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:35.773730 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-bf5483bf-cbbd-4665-aad9-8dc15f5c7ba7 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db87258db1424ce7a8399fdd05efe3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89d1b21ad8471a8a9a82adac2594c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:36:35.783970 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-bf5483bf-cbbd-4665-aad9-8dc15f5c7ba7 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] 10.222.0.45 "GET /compute/v2.1/servers/06ae865a-6ba5-4198-be6d-e6056e645411" status: 200 len: 1522 microversion: 2.1 time: 0.225055 Jan 21 09:36:35.785826 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 69/153] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:36:35 2022] GET /compute/v2.1/servers/06ae865a-6ba5-4198-be6d-e6056e645411 => generated 1522 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:36:35.938386 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-e9e595df-44dd-4696-96cb-d37a09706fe5 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:36:35.939838 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-e9e595df-44dd-4696-96cb-d37a09706fe5 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] [instance: 59ad64a5-af93-44ef-8031-fd2f2d18a901] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:36:35.950409 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-e9e595df-44dd-4696-96cb-d37a09706fe5 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:35.951702 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-e9e595df-44dd-4696-96cb-d37a09706fe5 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:35.953795 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-e9e595df-44dd-4696-96cb-d37a09706fe5 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:35.954495 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-e9e595df-44dd-4696-96cb-d37a09706fe5 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:35.972327 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-6ca6cf57-e7e2-4f98-80c5-0a6f97bcf11a tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b547a45bb54a8f94e9e5f5aeba7520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a31f7136c241578473d4d323722c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:36:35.986162 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-6ca6cf57-e7e2-4f98-80c5-0a6f97bcf11a tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] 10.222.0.45 "GET /compute/v2.1/servers/b50feb40-c691-4724-8570-f5873bdc5d1e" status: 200 len: 1315 microversion: 2.1 time: 0.273333 Jan 21 09:36:35.987521 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 85/154] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:36:35 2022] GET /compute/v2.1/servers/b50feb40-c691-4724-8570-f5873bdc5d1e => generated 1315 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 09:36:36.227203 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-2c54b418-6ea0-4594-b618-712fa7fdea8b tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:36:36.228003 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-2c54b418-6ea0-4594-b618-712fa7fdea8b tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] [instance: 370b78d2-d154-4c93-b8ef-3723bd26c3d4] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:36:36.242777 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-2c54b418-6ea0-4594-b618-712fa7fdea8b tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:36.244684 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-2c54b418-6ea0-4594-b618-712fa7fdea8b tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:36.247869 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-2c54b418-6ea0-4594-b618-712fa7fdea8b tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:36.251052 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-2c54b418-6ea0-4594-b618-712fa7fdea8b tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:36.260730 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-e9e595df-44dd-4696-96cb-d37a09706fe5 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:36:36.269733 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-e9e595df-44dd-4696-96cb-d37a09706fe5 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:36:36.277303 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-e9e595df-44dd-4696-96cb-d37a09706fe5 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:36:36.278457 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-e9e595df-44dd-4696-96cb-d37a09706fe5 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "GET /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901" status: 200 len: 1406 microversion: 2.20 time: 0.345765 Jan 21 09:36:36.279341 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 70/155] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jan 21 09:36:35 2022] GET /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901 => generated 1406 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 21 09:36:36.535665 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-2c54b418-6ea0-4594-b618-712fa7fdea8b tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7b2c14d9444d65ab7a874e749671bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3390729231b409e9a83376b428c1a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:36:36.550375 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-2c54b418-6ea0-4594-b618-712fa7fdea8b tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] 10.222.0.45 "GET /compute/v2.1/servers/370b78d2-d154-4c93-b8ef-3723bd26c3d4" status: 200 len: 1317 microversion: 2.1 time: 0.322520 Jan 21 09:36:36.551846 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 86/156] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:36:36 2022] GET /compute/v2.1/servers/370b78d2-d154-4c93-b8ef-3723bd26c3d4 => generated 1317 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 09:36:36.800817 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-9adfd0dc-0717-4875-a57d-3b02123246b7 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:36:36.801463 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-9adfd0dc-0717-4875-a57d-3b02123246b7 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] [instance: 06ae865a-6ba5-4198-be6d-e6056e645411] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:36:36.808852 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-9adfd0dc-0717-4875-a57d-3b02123246b7 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:36.809334 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-9adfd0dc-0717-4875-a57d-3b02123246b7 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:36.810176 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-9adfd0dc-0717-4875-a57d-3b02123246b7 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:36.810608 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-9adfd0dc-0717-4875-a57d-3b02123246b7 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:36.955658 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-9adfd0dc-0717-4875-a57d-3b02123246b7 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db87258db1424ce7a8399fdd05efe3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89d1b21ad8471a8a9a82adac2594c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:36:36.976649 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-9adfd0dc-0717-4875-a57d-3b02123246b7 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] 10.222.0.45 "GET /compute/v2.1/servers/06ae865a-6ba5-4198-be6d-e6056e645411" status: 200 len: 1522 microversion: 2.1 time: 0.173522 Jan 21 09:36:36.976649 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 71/157] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:36:36 2022] GET /compute/v2.1/servers/06ae865a-6ba5-4198-be6d-e6056e645411 => generated 1522 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:36:37.008026 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-a4bff650-fdd5-4ff1-9220-fcca4b6e8c0c tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:36:37.008846 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-a4bff650-fdd5-4ff1-9220-fcca4b6e8c0c tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] [instance: b50feb40-c691-4724-8570-f5873bdc5d1e] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:36:37.019950 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-a4bff650-fdd5-4ff1-9220-fcca4b6e8c0c tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:37.020413 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-a4bff650-fdd5-4ff1-9220-fcca4b6e8c0c tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:37.021237 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-a4bff650-fdd5-4ff1-9220-fcca4b6e8c0c tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:37.022743 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-a4bff650-fdd5-4ff1-9220-fcca4b6e8c0c tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:37.192360 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-a4bff650-fdd5-4ff1-9220-fcca4b6e8c0c tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b547a45bb54a8f94e9e5f5aeba7520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a31f7136c241578473d4d323722c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:36:37.200734 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-a4bff650-fdd5-4ff1-9220-fcca4b6e8c0c tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] 10.222.0.45 "GET /compute/v2.1/servers/b50feb40-c691-4724-8570-f5873bdc5d1e" status: 200 len: 1501 microversion: 2.1 time: 0.200669 Jan 21 09:36:37.202036 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 87/158] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:36:36 2022] GET /compute/v2.1/servers/b50feb40-c691-4724-8570-f5873bdc5d1e => generated 1501 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:36:37.297235 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-4b6052fa-7cee-41d7-a4b6-f92690115643 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:36:37.298134 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-4b6052fa-7cee-41d7-a4b6-f92690115643 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] [instance: 59ad64a5-af93-44ef-8031-fd2f2d18a901] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:36:37.304569 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-4b6052fa-7cee-41d7-a4b6-f92690115643 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:37.304999 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-4b6052fa-7cee-41d7-a4b6-f92690115643 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:37.305905 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-4b6052fa-7cee-41d7-a4b6-f92690115643 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:37.306276 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-4b6052fa-7cee-41d7-a4b6-f92690115643 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:37.463488 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-4b6052fa-7cee-41d7-a4b6-f92690115643 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:36:37.472009 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-4b6052fa-7cee-41d7-a4b6-f92690115643 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:36:37.473546 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-4b6052fa-7cee-41d7-a4b6-f92690115643 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:36:37.476330 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-4b6052fa-7cee-41d7-a4b6-f92690115643 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "GET /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901" status: 200 len: 1599 microversion: 2.20 time: 0.182185 Jan 21 09:36:37.477097 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 72/159] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jan 21 09:36:37 2022] GET /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901 => generated 1599 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 21 09:36:37.505392 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-39d0dc05-befe-4ace-a73b-7f55d69f3eff tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:36:37.511820 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-39d0dc05-befe-4ace-a73b-7f55d69f3eff tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] [instance: 59ad64a5-af93-44ef-8031-fd2f2d18a901] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:36:37.514308 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-39d0dc05-befe-4ace-a73b-7f55d69f3eff tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:37.515003 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-39d0dc05-befe-4ace-a73b-7f55d69f3eff tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:37.515855 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-39d0dc05-befe-4ace-a73b-7f55d69f3eff tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:37.516442 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-39d0dc05-befe-4ace-a73b-7f55d69f3eff tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:37.568157 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-81a2938d-d548-4a13-87cb-b160127a536c tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:36:37.570075 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-81a2938d-d548-4a13-87cb-b160127a536c tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] [instance: 370b78d2-d154-4c93-b8ef-3723bd26c3d4] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:36:37.579103 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-81a2938d-d548-4a13-87cb-b160127a536c tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:37.580197 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-81a2938d-d548-4a13-87cb-b160127a536c tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:37.581432 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-81a2938d-d548-4a13-87cb-b160127a536c tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:37.582143 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-81a2938d-d548-4a13-87cb-b160127a536c tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:37.804653 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-81a2938d-d548-4a13-87cb-b160127a536c tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7b2c14d9444d65ab7a874e749671bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3390729231b409e9a83376b428c1a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:36:37.813468 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-81a2938d-d548-4a13-87cb-b160127a536c tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] 10.222.0.45 "GET /compute/v2.1/servers/370b78d2-d154-4c93-b8ef-3723bd26c3d4" status: 200 len: 1508 microversion: 2.1 time: 0.248955 Jan 21 09:36:37.814502 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 73/160] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:36:37 2022] GET /compute/v2.1/servers/370b78d2-d154-4c93-b8ef-3723bd26c3d4 => generated 1508 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 09:36:37.847721 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-39d0dc05-befe-4ace-a73b-7f55d69f3eff tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "GET /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.354535 Jan 21 09:36:37.849289 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 88/161] 10.222.0.45 () {60 vars in 1315 bytes} [Fri Jan 21 09:36:37 2022] GET /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901/os-interface => generated 285 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 21 09:36:37.989698 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-d2ecbb09-8df1-4635-b8de-3b19339ff349 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:36:37.990687 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-d2ecbb09-8df1-4635-b8de-3b19339ff349 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] [instance: 06ae865a-6ba5-4198-be6d-e6056e645411] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:36:37.996961 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-d2ecbb09-8df1-4635-b8de-3b19339ff349 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:37.997762 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-d2ecbb09-8df1-4635-b8de-3b19339ff349 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:37.998771 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-d2ecbb09-8df1-4635-b8de-3b19339ff349 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:37.999458 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-d2ecbb09-8df1-4635-b8de-3b19339ff349 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:38.364198 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-d2ecbb09-8df1-4635-b8de-3b19339ff349 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db87258db1424ce7a8399fdd05efe3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89d1b21ad8471a8a9a82adac2594c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:36:38.373189 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-d2ecbb09-8df1-4635-b8de-3b19339ff349 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] 10.222.0.45 "GET /compute/v2.1/servers/06ae865a-6ba5-4198-be6d-e6056e645411" status: 200 len: 1522 microversion: 2.1 time: 0.389146 Jan 21 09:36:38.373751 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 74/162] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:36:37 2022] GET /compute/v2.1/servers/06ae865a-6ba5-4198-be6d-e6056e645411 => generated 1522 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:36:39.074589 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-6eda65a8-dfe9-4f03-9339-f6f92b64afec tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4f248ead-c909-42fa-868b-9495942985fd"}} {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:36:39.075664 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-6eda65a8-dfe9-4f03-9339-f6f92b64afec tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] [instance: b50feb40-c691-4724-8570-f5873bdc5d1e] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:36:39.083102 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-6eda65a8-dfe9-4f03-9339-f6f92b64afec tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:39.083556 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-6eda65a8-dfe9-4f03-9339-f6f92b64afec tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:39.085411 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-6eda65a8-dfe9-4f03-9339-f6f92b64afec tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:39.086174 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-6eda65a8-dfe9-4f03-9339-f6f92b64afec tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:39.391558 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-637dbb26-0c18-4888-ad1e-7ed3a57edec3 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:36:39.392409 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-637dbb26-0c18-4888-ad1e-7ed3a57edec3 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] [instance: 06ae865a-6ba5-4198-be6d-e6056e645411] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:36:39.418640 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-637dbb26-0c18-4888-ad1e-7ed3a57edec3 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:39.422558 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-637dbb26-0c18-4888-ad1e-7ed3a57edec3 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:39.422558 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-637dbb26-0c18-4888-ad1e-7ed3a57edec3 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:39.422558 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-637dbb26-0c18-4888-ad1e-7ed3a57edec3 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:39.688553 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-637dbb26-0c18-4888-ad1e-7ed3a57edec3 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db87258db1424ce7a8399fdd05efe3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89d1b21ad8471a8a9a82adac2594c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:36:39.697781 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-637dbb26-0c18-4888-ad1e-7ed3a57edec3 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] 10.222.0.45 "GET /compute/v2.1/servers/06ae865a-6ba5-4198-be6d-e6056e645411" status: 200 len: 1522 microversion: 2.1 time: 0.311159 Jan 21 09:36:39.698414 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 75/163] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:36:39 2022] GET /compute/v2.1/servers/06ae865a-6ba5-4198-be6d-e6056e645411 => generated 1522 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 09:36:39.879620 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-de58adcc-7fb7-444c-82fd-b12d32a6d88a tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:36:39.881458 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-de58adcc-7fb7-444c-82fd-b12d32a6d88a tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] [instance: 59ad64a5-af93-44ef-8031-fd2f2d18a901] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:36:39.887942 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-de58adcc-7fb7-444c-82fd-b12d32a6d88a tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:39.888384 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-de58adcc-7fb7-444c-82fd-b12d32a6d88a tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:39.889179 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-de58adcc-7fb7-444c-82fd-b12d32a6d88a tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:39.889776 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-de58adcc-7fb7-444c-82fd-b12d32a6d88a tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:40.025192 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-de58adcc-7fb7-444c-82fd-b12d32a6d88a tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "POST /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901/action" status: 200 len: 14 microversion: 2.20 time: 0.149596 Jan 21 09:36:40.025971 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 76/164] 10.222.0.45 () {62 vars in 1318 bytes} [Fri Jan 21 09:36:39 2022] POST /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901/action => generated 14 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:36:40.044275 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [req-c97dad57-cae0-4e7a-b344-9af74c389d96 req-1517acf0-d60c-4818-949f-14e9b690c08c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "59ad64a5-af93-44ef-8031-fd2f2d18a901", "tag": "63990fa3-fce3-4891-adb2-cd4ebc4c075a"}]} {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:36:40.050306 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 21 09:36:40.050306 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: warnings.warn(msg) Jan 21 09:36:40.059529 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [req-c97dad57-cae0-4e7a-b344-9af74c389d96 req-1517acf0-d60c-4818-949f-14e9b690c08c service nova] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:40.060392 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [req-c97dad57-cae0-4e7a-b344-9af74c389d96 req-1517acf0-d60c-4818-949f-14e9b690c08c service nova] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:40.074922 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.compute.server_external_events [req-c97dad57-cae0-4e7a-b344-9af74c389d96 req-1517acf0-d60c-4818-949f-14e9b690c08c service nova] Creating event network-changed:63990fa3-fce3-4891-adb2-cd4ebc4c075a for instance 59ad64a5-af93-44ef-8031-fd2f2d18a901 on hv-cinder-80403 Jan 21 09:36:40.086548 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [req-c97dad57-cae0-4e7a-b344-9af74c389d96 req-1517acf0-d60c-4818-949f-14e9b690c08c service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055770 Jan 21 09:36:40.087312 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 77/165] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Jan 21 09:36:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 09:36:40.094327 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-666fdeb0-decf-41f2-89a3-b250b5fe4aea tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "33687222-3e22-4b2c-a1eb-00913bdb131f"}} {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:36:40.096063 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-666fdeb0-decf-41f2-89a3-b250b5fe4aea tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] [instance: 370b78d2-d154-4c93-b8ef-3723bd26c3d4] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:36:40.105065 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-666fdeb0-decf-41f2-89a3-b250b5fe4aea tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:40.108178 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-666fdeb0-decf-41f2-89a3-b250b5fe4aea tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:40.108178 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-666fdeb0-decf-41f2-89a3-b250b5fe4aea tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:40.108178 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-666fdeb0-decf-41f2-89a3-b250b5fe4aea tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:40.300084 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-6eda65a8-dfe9-4f03-9339-f6f92b64afec tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] 10.222.0.45 "POST /compute/v2.1/servers/b50feb40-c691-4724-8570-f5873bdc5d1e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.232431 Jan 21 09:36:40.303191 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 89/166] 10.222.0.45 () {60 vars in 1322 bytes} [Fri Jan 21 09:36:39 2022] POST /compute/v2.1/servers/b50feb40-c691-4724-8570-f5873bdc5d1e/os-volume_attachments => generated 194 bytes in 1236 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 09:36:40.719880 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-51b0a2a9-abe9-40db-8348-4a0d0ab60a92 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:36:40.721035 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-51b0a2a9-abe9-40db-8348-4a0d0ab60a92 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] [instance: 06ae865a-6ba5-4198-be6d-e6056e645411] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:36:40.749139 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-51b0a2a9-abe9-40db-8348-4a0d0ab60a92 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:40.750186 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-51b0a2a9-abe9-40db-8348-4a0d0ab60a92 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:40.752497 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-51b0a2a9-abe9-40db-8348-4a0d0ab60a92 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:40.754281 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-51b0a2a9-abe9-40db-8348-4a0d0ab60a92 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:41.161364 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-51b0a2a9-abe9-40db-8348-4a0d0ab60a92 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db87258db1424ce7a8399fdd05efe3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89d1b21ad8471a8a9a82adac2594c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:36:41.170393 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-51b0a2a9-abe9-40db-8348-4a0d0ab60a92 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] 10.222.0.45 "GET /compute/v2.1/servers/06ae865a-6ba5-4198-be6d-e6056e645411" status: 200 len: 1522 microversion: 2.1 time: 0.458060 Jan 21 09:36:41.171195 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 90/167] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:36:40 2022] GET /compute/v2.1/servers/06ae865a-6ba5-4198-be6d-e6056e645411 => generated 1522 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:36:41.176056 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-50a70a0d-b659-4dea-945f-8eb15591fc47 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:36:41.186640 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-50a70a0d-b659-4dea-945f-8eb15591fc47 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] [instance: 59ad64a5-af93-44ef-8031-fd2f2d18a901] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:36:41.196459 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-50a70a0d-b659-4dea-945f-8eb15591fc47 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:41.196984 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-50a70a0d-b659-4dea-945f-8eb15591fc47 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:41.197825 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-50a70a0d-b659-4dea-945f-8eb15591fc47 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:41.198264 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-50a70a0d-b659-4dea-945f-8eb15591fc47 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:41.299289 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-50a70a0d-b659-4dea-945f-8eb15591fc47 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "POST /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901/action" status: 200 len: 14 microversion: 2.20 time: 0.126646 Jan 21 09:36:41.299926 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 91/168] 10.222.0.45 () {62 vars in 1318 bytes} [Fri Jan 21 09:36:41 2022] POST /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901/action => generated 14 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:36:41.313920 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-666fdeb0-decf-41f2-89a3-b250b5fe4aea tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] 10.222.0.45 "POST /compute/v2.1/servers/370b78d2-d154-4c93-b8ef-3723bd26c3d4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.223293 Jan 21 09:36:41.315203 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 78/169] 10.222.0.45 () {60 vars in 1322 bytes} [Fri Jan 21 09:36:40 2022] POST /compute/v2.1/servers/370b78d2-d154-4c93-b8ef-3723bd26c3d4/os-volume_attachments => generated 194 bytes in 1227 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 09:36:42.188639 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-09670962-3998-4d5d-968e-f33565e40820 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:36:42.189272 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-09670962-3998-4d5d-968e-f33565e40820 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] [instance: 06ae865a-6ba5-4198-be6d-e6056e645411] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:36:42.196639 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-09670962-3998-4d5d-968e-f33565e40820 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:42.197090 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-09670962-3998-4d5d-968e-f33565e40820 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:42.197950 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-09670962-3998-4d5d-968e-f33565e40820 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:42.202809 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-09670962-3998-4d5d-968e-f33565e40820 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:42.317718 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-c6c3bed8-7648-44fe-8804-298b817045b4 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:36:42.320163 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-c6c3bed8-7648-44fe-8804-298b817045b4 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] [instance: 59ad64a5-af93-44ef-8031-fd2f2d18a901] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:36:42.329344 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-c6c3bed8-7648-44fe-8804-298b817045b4 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:42.330090 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-c6c3bed8-7648-44fe-8804-298b817045b4 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:42.331377 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-c6c3bed8-7648-44fe-8804-298b817045b4 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:42.332108 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-c6c3bed8-7648-44fe-8804-298b817045b4 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:42.358342 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-09670962-3998-4d5d-968e-f33565e40820 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db87258db1424ce7a8399fdd05efe3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89d1b21ad8471a8a9a82adac2594c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:36:42.367109 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-09670962-3998-4d5d-968e-f33565e40820 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] 10.222.0.45 "GET /compute/v2.1/servers/06ae865a-6ba5-4198-be6d-e6056e645411" status: 200 len: 1522 microversion: 2.1 time: 0.182445 Jan 21 09:36:42.367687 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 92/170] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:36:42 2022] GET /compute/v2.1/servers/06ae865a-6ba5-4198-be6d-e6056e645411 => generated 1522 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:36:42.404295 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-c6c3bed8-7648-44fe-8804-298b817045b4 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "POST /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901/action" status: 200 len: 14 microversion: 2.20 time: 0.091593 Jan 21 09:36:42.407661 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 79/171] 10.222.0.45 () {62 vars in 1318 bytes} [Fri Jan 21 09:36:42 2022] POST /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901/action => generated 14 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 09:36:43.384585 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-ac775f55-6123-438b-bbb9-22f824d9bf6a tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:36:43.385963 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-ac775f55-6123-438b-bbb9-22f824d9bf6a tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] [instance: 06ae865a-6ba5-4198-be6d-e6056e645411] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:36:43.392414 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-ac775f55-6123-438b-bbb9-22f824d9bf6a tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:43.392947 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-ac775f55-6123-438b-bbb9-22f824d9bf6a tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:43.393869 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-ac775f55-6123-438b-bbb9-22f824d9bf6a tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:43.394380 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-ac775f55-6123-438b-bbb9-22f824d9bf6a tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:43.417805 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-2a83222c-c180-4e34-b027-202826db036e tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:36:43.419615 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-2a83222c-c180-4e34-b027-202826db036e tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] [instance: 59ad64a5-af93-44ef-8031-fd2f2d18a901] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:36:43.427656 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-2a83222c-c180-4e34-b027-202826db036e tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:43.428336 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-2a83222c-c180-4e34-b027-202826db036e tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:43.430076 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-2a83222c-c180-4e34-b027-202826db036e tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:43.430619 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-2a83222c-c180-4e34-b027-202826db036e tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:43.499198 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-2a83222c-c180-4e34-b027-202826db036e tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "POST /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901/action" status: 200 len: 14 microversion: 2.20 time: 0.086649 Jan 21 09:36:43.500645 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 80/172] 10.222.0.45 () {62 vars in 1318 bytes} [Fri Jan 21 09:36:43 2022] POST /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901/action => generated 14 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 09:36:43.559422 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-ac775f55-6123-438b-bbb9-22f824d9bf6a tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db87258db1424ce7a8399fdd05efe3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89d1b21ad8471a8a9a82adac2594c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:36:43.571706 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-ac775f55-6123-438b-bbb9-22f824d9bf6a tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] 10.222.0.45 "GET /compute/v2.1/servers/06ae865a-6ba5-4198-be6d-e6056e645411" status: 200 len: 1522 microversion: 2.1 time: 0.190966 Jan 21 09:36:43.577730 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 93/173] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:36:43 2022] GET /compute/v2.1/servers/06ae865a-6ba5-4198-be6d-e6056e645411 => generated 1522 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:36:44.511167 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-95d6d8c4-bd2a-4851-ab37-cc589cb21616 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:36:44.512159 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-95d6d8c4-bd2a-4851-ab37-cc589cb21616 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] [instance: 59ad64a5-af93-44ef-8031-fd2f2d18a901] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:36:44.519171 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-95d6d8c4-bd2a-4851-ab37-cc589cb21616 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:44.519617 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-95d6d8c4-bd2a-4851-ab37-cc589cb21616 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:44.520406 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-95d6d8c4-bd2a-4851-ab37-cc589cb21616 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:44.520840 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-95d6d8c4-bd2a-4851-ab37-cc589cb21616 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:44.602213 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-95d6d8c4-bd2a-4851-ab37-cc589cb21616 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "POST /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901/action" status: 200 len: 14 microversion: 2.20 time: 0.094408 Jan 21 09:36:44.604118 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-4ae91a1b-e7d5-49ea-b0b4-3909155cc727 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:36:44.605078 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 81/174] 10.222.0.45 () {62 vars in 1318 bytes} [Fri Jan 21 09:36:44 2022] POST /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901/action => generated 14 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 09:36:44.606483 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-4ae91a1b-e7d5-49ea-b0b4-3909155cc727 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] [instance: 06ae865a-6ba5-4198-be6d-e6056e645411] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:36:44.615839 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-4ae91a1b-e7d5-49ea-b0b4-3909155cc727 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:44.616399 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-4ae91a1b-e7d5-49ea-b0b4-3909155cc727 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:44.617729 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-4ae91a1b-e7d5-49ea-b0b4-3909155cc727 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:44.618172 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-4ae91a1b-e7d5-49ea-b0b4-3909155cc727 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:44.802763 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-4ae91a1b-e7d5-49ea-b0b4-3909155cc727 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db87258db1424ce7a8399fdd05efe3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89d1b21ad8471a8a9a82adac2594c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:36:44.812237 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-4ae91a1b-e7d5-49ea-b0b4-3909155cc727 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] 10.222.0.45 "GET /compute/v2.1/servers/06ae865a-6ba5-4198-be6d-e6056e645411" status: 200 len: 1522 microversion: 2.1 time: 0.217626 Jan 21 09:36:44.813274 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 94/175] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:36:44 2022] GET /compute/v2.1/servers/06ae865a-6ba5-4198-be6d-e6056e645411 => generated 1522 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 09:36:45.617807 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-e0978852-26a8-45ea-92a1-498386274347 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:36:45.619522 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-e0978852-26a8-45ea-92a1-498386274347 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] [instance: 59ad64a5-af93-44ef-8031-fd2f2d18a901] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:36:45.636729 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-e0978852-26a8-45ea-92a1-498386274347 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:45.637352 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-e0978852-26a8-45ea-92a1-498386274347 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:45.638230 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-e0978852-26a8-45ea-92a1-498386274347 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:45.638678 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-e0978852-26a8-45ea-92a1-498386274347 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:45.733555 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-e0978852-26a8-45ea-92a1-498386274347 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "POST /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901/action" status: 200 len: 14 microversion: 2.20 time: 0.121567 Jan 21 09:36:45.734299 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 82/176] 10.222.0.45 () {62 vars in 1318 bytes} [Fri Jan 21 09:36:45 2022] POST /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901/action => generated 14 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:36:45.832173 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-f285a823-7113-4a53-a315-540afd6539b9 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:36:45.834096 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-f285a823-7113-4a53-a315-540afd6539b9 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] [instance: 06ae865a-6ba5-4198-be6d-e6056e645411] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:36:45.854651 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-f285a823-7113-4a53-a315-540afd6539b9 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:45.858316 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-f285a823-7113-4a53-a315-540afd6539b9 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:45.864638 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-f285a823-7113-4a53-a315-540afd6539b9 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:45.864638 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-f285a823-7113-4a53-a315-540afd6539b9 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:46.170857 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-f285a823-7113-4a53-a315-540afd6539b9 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db87258db1424ce7a8399fdd05efe3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89d1b21ad8471a8a9a82adac2594c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:36:46.180817 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-f285a823-7113-4a53-a315-540afd6539b9 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] 10.222.0.45 "GET /compute/v2.1/servers/06ae865a-6ba5-4198-be6d-e6056e645411" status: 200 len: 1522 microversion: 2.1 time: 0.353169 Jan 21 09:36:46.181787 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 95/177] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:36:45 2022] GET /compute/v2.1/servers/06ae865a-6ba5-4198-be6d-e6056e645411 => generated 1522 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:36:46.746062 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-e850600b-b7d1-405f-b6ff-2096094f04a9 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:36:46.747647 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-e850600b-b7d1-405f-b6ff-2096094f04a9 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] [instance: 59ad64a5-af93-44ef-8031-fd2f2d18a901] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:36:46.760795 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-e850600b-b7d1-405f-b6ff-2096094f04a9 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:46.760795 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-e850600b-b7d1-405f-b6ff-2096094f04a9 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:46.760795 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-e850600b-b7d1-405f-b6ff-2096094f04a9 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:46.760795 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-e850600b-b7d1-405f-b6ff-2096094f04a9 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:46.860092 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-e850600b-b7d1-405f-b6ff-2096094f04a9 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "POST /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901/action" status: 200 len: 14 microversion: 2.20 time: 0.118013 Jan 21 09:36:46.860814 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 83/178] 10.222.0.45 () {62 vars in 1318 bytes} [Fri Jan 21 09:36:46 2022] POST /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901/action => generated 14 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:36:47.198762 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-0628824d-2650-40f6-bc1b-14e169a180ad tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:36:47.199371 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-0628824d-2650-40f6-bc1b-14e169a180ad tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] [instance: 06ae865a-6ba5-4198-be6d-e6056e645411] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:36:47.214868 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-0628824d-2650-40f6-bc1b-14e169a180ad tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:47.215597 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-0628824d-2650-40f6-bc1b-14e169a180ad tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:47.216409 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-0628824d-2650-40f6-bc1b-14e169a180ad tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:47.217225 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-0628824d-2650-40f6-bc1b-14e169a180ad tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:47.367800 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-0628824d-2650-40f6-bc1b-14e169a180ad tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db87258db1424ce7a8399fdd05efe3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89d1b21ad8471a8a9a82adac2594c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:36:47.375278 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-0628824d-2650-40f6-bc1b-14e169a180ad tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] 10.222.0.45 "GET /compute/v2.1/servers/06ae865a-6ba5-4198-be6d-e6056e645411" status: 200 len: 1522 microversion: 2.1 time: 0.182014 Jan 21 09:36:47.376417 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 96/179] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:36:47 2022] GET /compute/v2.1/servers/06ae865a-6ba5-4198-be6d-e6056e645411 => generated 1522 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 09:36:47.896039 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-d59b9dda-4610-45eb-8fb4-fc1df0c7cc65 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:36:47.896039 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-d59b9dda-4610-45eb-8fb4-fc1df0c7cc65 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] [instance: 59ad64a5-af93-44ef-8031-fd2f2d18a901] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:36:47.896039 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-d59b9dda-4610-45eb-8fb4-fc1df0c7cc65 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:47.896039 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-d59b9dda-4610-45eb-8fb4-fc1df0c7cc65 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:47.897546 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-d59b9dda-4610-45eb-8fb4-fc1df0c7cc65 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:47.897546 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-d59b9dda-4610-45eb-8fb4-fc1df0c7cc65 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:47.961676 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-d59b9dda-4610-45eb-8fb4-fc1df0c7cc65 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "POST /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901/action" status: 200 len: 14 microversion: 2.20 time: 0.088343 Jan 21 09:36:47.993115 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 84/180] 10.222.0.45 () {62 vars in 1318 bytes} [Fri Jan 21 09:36:47 2022] POST /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901/action => generated 14 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:36:48.399431 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-95e520a4-8858-476b-b4bf-99b911f6a62f tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:36:48.399431 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-95e520a4-8858-476b-b4bf-99b911f6a62f tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] [instance: 06ae865a-6ba5-4198-be6d-e6056e645411] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:36:48.402845 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-95e520a4-8858-476b-b4bf-99b911f6a62f tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:48.403302 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-95e520a4-8858-476b-b4bf-99b911f6a62f tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:48.404425 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-95e520a4-8858-476b-b4bf-99b911f6a62f tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:48.404841 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-95e520a4-8858-476b-b4bf-99b911f6a62f tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:48.554299 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-95e520a4-8858-476b-b4bf-99b911f6a62f tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db87258db1424ce7a8399fdd05efe3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89d1b21ad8471a8a9a82adac2594c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:36:48.563751 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-95e520a4-8858-476b-b4bf-99b911f6a62f tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] 10.222.0.45 "GET /compute/v2.1/servers/06ae865a-6ba5-4198-be6d-e6056e645411" status: 200 len: 1522 microversion: 2.1 time: 0.172903 Jan 21 09:36:48.564495 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 97/181] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:36:48 2022] GET /compute/v2.1/servers/06ae865a-6ba5-4198-be6d-e6056e645411 => generated 1522 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:36:48.886565 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-50cb474d-4e54-4401-8b49-195c582a70be tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-997127866", "imageRef": "813e53ee-82e7-4a13-9f63-a8be7b1089f1", "flavorRef": "452", "networks": [{"uuid": "7ccd0197-ed42-4d03-8ffc-af304fe19f70"}]}} {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:36:48.954426 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.network.neutron [None req-50cb474d-4e54-4401-8b49-195c582a70be tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] validate_networks() for [('7ccd0197-ed42-4d03-8ffc-af304fe19f70', None, None, None, None, None)] {{(pid=123386) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 21 09:36:49.000751 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-c9ddadab-6141-43c8-b556-48155ee3227e tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:36:49.001866 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-c9ddadab-6141-43c8-b556-48155ee3227e tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] [instance: 59ad64a5-af93-44ef-8031-fd2f2d18a901] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:36:49.009673 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-c9ddadab-6141-43c8-b556-48155ee3227e tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:49.010196 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-c9ddadab-6141-43c8-b556-48155ee3227e tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:49.011028 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-c9ddadab-6141-43c8-b556-48155ee3227e tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:49.011376 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-c9ddadab-6141-43c8-b556-48155ee3227e tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:49.098030 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-c9ddadab-6141-43c8-b556-48155ee3227e tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "POST /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901/action" status: 200 len: 14 microversion: 2.20 time: 0.103145 Jan 21 09:36:49.100008 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 98/182] 10.222.0.45 () {62 vars in 1318 bytes} [Fri Jan 21 09:36:48 2022] POST /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901/action => generated 14 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:36:49.434653 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.virt.hardware [None req-50cb474d-4e54-4401-8b49-195c582a70be tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Flavor limits 0:0:0 {{(pid=123386) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 21 09:36:49.435222 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.virt.hardware [None req-50cb474d-4e54-4401-8b49-195c582a70be tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Image limits 0:0:0 {{(pid=123386) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 21 09:36:49.436468 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.virt.hardware [None req-50cb474d-4e54-4401-8b49-195c582a70be tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Flavor pref 0:0:0 {{(pid=123386) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 21 09:36:49.436883 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.virt.hardware [None req-50cb474d-4e54-4401-8b49-195c582a70be tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Image pref 0:0:0 {{(pid=123386) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 21 09:36:49.437317 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.virt.hardware [None req-50cb474d-4e54-4401-8b49-195c582a70be tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123386) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 21 09:36:49.447712 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-50cb474d-4e54-4401-8b49-195c582a70be tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:49.448164 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-50cb474d-4e54-4401-8b49-195c582a70be tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:49.449010 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-50cb474d-4e54-4401-8b49-195c582a70be tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:49.449552 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-50cb474d-4e54-4401-8b49-195c582a70be tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:49.467990 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.quota [None req-50cb474d-4e54-4401-8b49-195c582a70be tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Getting quotas for project 5db07feb3a43432999da539b6b85fb2a. Resources: {'cores', 'instances', 'ram'} {{(pid=123386) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 21 09:36:49.478516 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.quota [None req-50cb474d-4e54-4401-8b49-195c582a70be tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Getting quotas for user 498146f6a6814129b393e7084057bfd0 and project 5db07feb3a43432999da539b6b85fb2a. Resources: {'cores', 'instances', 'ram'} {{(pid=123386) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 21 09:36:49.485062 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-50cb474d-4e54-4401-8b49-195c582a70be tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Going to run 1 instances... {{(pid=123386) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 21 09:36:49.488223 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-50cb474d-4e54-4401-8b49-195c582a70be tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] [instance: deb54068-874d-4b55-ab9c-777c53b1d707] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='813e53ee-82e7-4a13-9f63-a8be7b1089f1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123386) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 21 09:36:49.582307 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-e86de3f9-c72e-40bf-a5e6-04e4aaeadf82 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:36:49.583258 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-e86de3f9-c72e-40bf-a5e6-04e4aaeadf82 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] [instance: 06ae865a-6ba5-4198-be6d-e6056e645411] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:36:49.592889 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-e86de3f9-c72e-40bf-a5e6-04e4aaeadf82 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:49.593684 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-e86de3f9-c72e-40bf-a5e6-04e4aaeadf82 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:49.594499 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-e86de3f9-c72e-40bf-a5e6-04e4aaeadf82 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:49.595240 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-e86de3f9-c72e-40bf-a5e6-04e4aaeadf82 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:49.683935 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-50cb474d-4e54-4401-8b49-195c582a70be tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.801472 Jan 21 09:36:49.688067 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 85/183] 10.222.0.45 () {60 vars in 1146 bytes} [Fri Jan 21 09:36:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 806 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 21 09:36:49.698572 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-93858cff-2921-4107-9dbd-bc3a5fd3ce6e tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:36:49.699212 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-93858cff-2921-4107-9dbd-bc3a5fd3ce6e tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] [instance: deb54068-874d-4b55-ab9c-777c53b1d707] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:36:49.800649 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-93858cff-2921-4107-9dbd-bc3a5fd3ce6e tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498146f6a6814129b393e7084057bfd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db07feb3a43432999da539b6b85fb2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:36:49.809636 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-93858cff-2921-4107-9dbd-bc3a5fd3ce6e tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] 10.222.0.45 "GET /compute/v2.1/servers/deb54068-874d-4b55-ab9c-777c53b1d707" status: 200 len: 1218 microversion: 2.1 time: 0.118487 Jan 21 09:36:49.820274 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 86/184] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:36:49 2022] GET /compute/v2.1/servers/deb54068-874d-4b55-ab9c-777c53b1d707 => generated 1218 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:36:49.827934 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-e86de3f9-c72e-40bf-a5e6-04e4aaeadf82 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db87258db1424ce7a8399fdd05efe3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89d1b21ad8471a8a9a82adac2594c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:36:49.835408 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-e86de3f9-c72e-40bf-a5e6-04e4aaeadf82 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] 10.222.0.45 "GET /compute/v2.1/servers/06ae865a-6ba5-4198-be6d-e6056e645411" status: 200 len: 1522 microversion: 2.1 time: 0.257336 Jan 21 09:36:49.836629 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 99/185] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:36:49 2022] GET /compute/v2.1/servers/06ae865a-6ba5-4198-be6d-e6056e645411 => generated 1522 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 09:36:50.110055 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-08fee7a6-46fb-4e42-8425-3a6307ef9927 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:36:50.115534 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-08fee7a6-46fb-4e42-8425-3a6307ef9927 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] [instance: 59ad64a5-af93-44ef-8031-fd2f2d18a901] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:36:50.121072 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-08fee7a6-46fb-4e42-8425-3a6307ef9927 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:50.121072 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-08fee7a6-46fb-4e42-8425-3a6307ef9927 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:50.122332 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-08fee7a6-46fb-4e42-8425-3a6307ef9927 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:50.122806 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-08fee7a6-46fb-4e42-8425-3a6307ef9927 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:50.206312 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-08fee7a6-46fb-4e42-8425-3a6307ef9927 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "POST /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901/action" status: 200 len: 14 microversion: 2.20 time: 0.099644 Jan 21 09:36:50.210434 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 87/186] 10.222.0.45 () {62 vars in 1318 bytes} [Fri Jan 21 09:36:50 2022] POST /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901/action => generated 14 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:36:50.788557 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-1674a2f5-658c-4018-b2fd-989b2b46781b tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:36:50.789173 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-1674a2f5-658c-4018-b2fd-989b2b46781b tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] [instance: b50feb40-c691-4724-8570-f5873bdc5d1e] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:36:50.798171 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-1674a2f5-658c-4018-b2fd-989b2b46781b tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:50.798619 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-1674a2f5-658c-4018-b2fd-989b2b46781b tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:50.799469 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-1674a2f5-658c-4018-b2fd-989b2b46781b tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:50.799830 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-1674a2f5-658c-4018-b2fd-989b2b46781b tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:50.827177 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-1674a2f5-658c-4018-b2fd-989b2b46781b tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] [instance: b50feb40-c691-4724-8570-f5873bdc5d1e] Going to try to terminate instance {{(pid=123387) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 21 09:36:50.831568 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-ad574694-0623-4252-a869-935a48aeca20 tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:36:50.832500 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-ad574694-0623-4252-a869-935a48aeca20 tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] [instance: deb54068-874d-4b55-ab9c-777c53b1d707] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:36:50.842786 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-ad574694-0623-4252-a869-935a48aeca20 tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:50.843621 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-ad574694-0623-4252-a869-935a48aeca20 tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:50.845533 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-ad574694-0623-4252-a869-935a48aeca20 tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:50.846215 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-ad574694-0623-4252-a869-935a48aeca20 tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:50.923213 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-ad574694-0623-4252-a869-935a48aeca20 tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498146f6a6814129b393e7084057bfd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db07feb3a43432999da539b6b85fb2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:36:50.931736 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-ad574694-0623-4252-a869-935a48aeca20 tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] 10.222.0.45 "GET /compute/v2.1/servers/deb54068-874d-4b55-ab9c-777c53b1d707" status: 200 len: 1222 microversion: 2.1 time: 0.107495 Jan 21 09:36:50.932628 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 88/187] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:36:50 2022] GET /compute/v2.1/servers/deb54068-874d-4b55-ab9c-777c53b1d707 => generated 1222 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:36:50.940139 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-e7e1e9a1-a6c7-4ce9-a81d-bd01364d2ff2 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:36:50.940845 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-e7e1e9a1-a6c7-4ce9-a81d-bd01364d2ff2 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] [instance: 06ae865a-6ba5-4198-be6d-e6056e645411] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:36:50.948447 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-e7e1e9a1-a6c7-4ce9-a81d-bd01364d2ff2 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:50.948447 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-e7e1e9a1-a6c7-4ce9-a81d-bd01364d2ff2 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:50.949046 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-e7e1e9a1-a6c7-4ce9-a81d-bd01364d2ff2 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:50.949531 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-e7e1e9a1-a6c7-4ce9-a81d-bd01364d2ff2 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:51.103716 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-e7e1e9a1-a6c7-4ce9-a81d-bd01364d2ff2 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db87258db1424ce7a8399fdd05efe3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89d1b21ad8471a8a9a82adac2594c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:36:51.115563 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-e7e1e9a1-a6c7-4ce9-a81d-bd01364d2ff2 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] 10.222.0.45 "GET /compute/v2.1/servers/06ae865a-6ba5-4198-be6d-e6056e645411" status: 200 len: 1522 microversion: 2.1 time: 0.178242 Jan 21 09:36:51.115563 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 89/188] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:36:50 2022] GET /compute/v2.1/servers/06ae865a-6ba5-4198-be6d-e6056e645411 => generated 1522 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:36:51.218511 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-1674a2f5-658c-4018-b2fd-989b2b46781b tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] 10.222.0.45 "DELETE /compute/v2.1/servers/b50feb40-c691-4724-8570-f5873bdc5d1e" status: 204 len: 0 microversion: 2.1 time: 0.435130 Jan 21 09:36:51.218965 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-c08d43a8-0d2f-4f5a-859d-59beb27fbf92 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:36:51.219512 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 100/189] 10.222.0.45 () {58 vars in 1238 bytes} [Fri Jan 21 09:36:50 2022] DELETE /compute/v2.1/servers/b50feb40-c691-4724-8570-f5873bdc5d1e => generated 0 bytes in 437 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 21 09:36:51.220524 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-c08d43a8-0d2f-4f5a-859d-59beb27fbf92 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] [instance: 59ad64a5-af93-44ef-8031-fd2f2d18a901] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:36:51.228492 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-c08d43a8-0d2f-4f5a-859d-59beb27fbf92 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:51.228943 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-c9c3f774-ec0e-4413-b382-808d230887d8 tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:36:51.229485 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-c08d43a8-0d2f-4f5a-859d-59beb27fbf92 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:51.229822 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-c9c3f774-ec0e-4413-b382-808d230887d8 tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] [instance: b50feb40-c691-4724-8570-f5873bdc5d1e] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:36:51.230802 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-c08d43a8-0d2f-4f5a-859d-59beb27fbf92 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:51.231407 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-c08d43a8-0d2f-4f5a-859d-59beb27fbf92 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:51.236182 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-c9c3f774-ec0e-4413-b382-808d230887d8 tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:51.240400 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-c9c3f774-ec0e-4413-b382-808d230887d8 tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:51.240400 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-c9c3f774-ec0e-4413-b382-808d230887d8 tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:51.240400 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-c9c3f774-ec0e-4413-b382-808d230887d8 tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:51.344175 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-c08d43a8-0d2f-4f5a-859d-59beb27fbf92 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "POST /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901/action" status: 200 len: 5760 microversion: 2.20 time: 0.128955 Jan 21 09:36:51.344833 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 90/190] 10.222.0.45 () {62 vars in 1318 bytes} [Fri Jan 21 09:36:51 2022] POST /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901/action => generated 5760 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 21 09:36:51.391542 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-c9c3f774-ec0e-4413-b382-808d230887d8 tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b547a45bb54a8f94e9e5f5aeba7520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a31f7136c241578473d4d323722c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:36:51.401285 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-c9c3f774-ec0e-4413-b382-808d230887d8 tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] 10.222.0.45 "GET /compute/v2.1/servers/b50feb40-c691-4724-8570-f5873bdc5d1e" status: 200 len: 1553 microversion: 2.1 time: 0.177098 Jan 21 09:36:51.402102 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 101/191] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:36:51 2022] GET /compute/v2.1/servers/b50feb40-c691-4724-8570-f5873bdc5d1e => generated 1553 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 09:36:51.950965 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-b8aa9a10-5b2f-456f-a716-8d430177cebd tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:36:51.951945 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-b8aa9a10-5b2f-456f-a716-8d430177cebd tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] [instance: deb54068-874d-4b55-ab9c-777c53b1d707] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:36:51.961193 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-b8aa9a10-5b2f-456f-a716-8d430177cebd tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:51.961933 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-b8aa9a10-5b2f-456f-a716-8d430177cebd tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:51.963013 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-b8aa9a10-5b2f-456f-a716-8d430177cebd tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:51.963656 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-b8aa9a10-5b2f-456f-a716-8d430177cebd tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:52.050956 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-b8aa9a10-5b2f-456f-a716-8d430177cebd tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498146f6a6814129b393e7084057bfd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db07feb3a43432999da539b6b85fb2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:36:52.059806 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-b8aa9a10-5b2f-456f-a716-8d430177cebd tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] 10.222.0.45 "GET /compute/v2.1/servers/deb54068-874d-4b55-ab9c-777c53b1d707" status: 200 len: 1270 microversion: 2.1 time: 0.112989 Jan 21 09:36:52.071106 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 91/192] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:36:51 2022] GET /compute/v2.1/servers/deb54068-874d-4b55-ab9c-777c53b1d707 => generated 1270 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:36:52.128703 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-7860a865-253b-464a-9a32-41038a4fff81 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:36:52.134689 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-7860a865-253b-464a-9a32-41038a4fff81 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] [instance: 06ae865a-6ba5-4198-be6d-e6056e645411] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:36:52.144702 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-7860a865-253b-464a-9a32-41038a4fff81 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:52.145467 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-7860a865-253b-464a-9a32-41038a4fff81 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:52.148097 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-7860a865-253b-464a-9a32-41038a4fff81 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:52.149125 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-7860a865-253b-464a-9a32-41038a4fff81 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:52.335415 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-7860a865-253b-464a-9a32-41038a4fff81 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db87258db1424ce7a8399fdd05efe3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89d1b21ad8471a8a9a82adac2594c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:36:52.358186 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-86abc95a-eb49-48a2-bce8-cbe63339a94a tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:36:52.359387 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-86abc95a-eb49-48a2-bce8-cbe63339a94a tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] [instance: 59ad64a5-af93-44ef-8031-fd2f2d18a901] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:36:52.366321 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-86abc95a-eb49-48a2-bce8-cbe63339a94a tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:52.366875 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-86abc95a-eb49-48a2-bce8-cbe63339a94a tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:52.367726 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-86abc95a-eb49-48a2-bce8-cbe63339a94a tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:52.368397 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-86abc95a-eb49-48a2-bce8-cbe63339a94a tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:52.378079 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-7860a865-253b-464a-9a32-41038a4fff81 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] 10.222.0.45 "GET /compute/v2.1/servers/06ae865a-6ba5-4198-be6d-e6056e645411" status: 200 len: 1522 microversion: 2.1 time: 0.253109 Jan 21 09:36:52.381123 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 102/193] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:36:52 2022] GET /compute/v2.1/servers/06ae865a-6ba5-4198-be6d-e6056e645411 => generated 1522 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:36:52.419176 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-ed3d3ffa-0009-4c60-be41-7fee047792b0 tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:36:52.420206 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-ed3d3ffa-0009-4c60-be41-7fee047792b0 tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] [instance: b50feb40-c691-4724-8570-f5873bdc5d1e] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:36:52.427289 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-ed3d3ffa-0009-4c60-be41-7fee047792b0 tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:52.427737 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-ed3d3ffa-0009-4c60-be41-7fee047792b0 tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:52.429856 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-ed3d3ffa-0009-4c60-be41-7fee047792b0 tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:52.430986 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-ed3d3ffa-0009-4c60-be41-7fee047792b0 tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:52.475538 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-86abc95a-eb49-48a2-bce8-cbe63339a94a tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "POST /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901/action" status: 200 len: 8435 microversion: 2.20 time: 0.122303 Jan 21 09:36:52.476173 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 92/194] 10.222.0.45 () {62 vars in 1318 bytes} [Fri Jan 21 09:36:52 2022] POST /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901/action => generated 8435 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 21 09:36:52.690381 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-ed3d3ffa-0009-4c60-be41-7fee047792b0 tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b547a45bb54a8f94e9e5f5aeba7520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a31f7136c241578473d4d323722c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:36:52.703224 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-ed3d3ffa-0009-4c60-be41-7fee047792b0 tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] 10.222.0.45 "GET /compute/v2.1/servers/b50feb40-c691-4724-8570-f5873bdc5d1e" status: 200 len: 1553 microversion: 2.1 time: 0.287822 Jan 21 09:36:52.709164 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 103/195] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:36:52 2022] GET /compute/v2.1/servers/b50feb40-c691-4724-8570-f5873bdc5d1e => generated 1553 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 09:36:53.078782 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-70112f1f-1b52-4aeb-b6d5-dd19caffa289 tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:36:53.079715 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-70112f1f-1b52-4aeb-b6d5-dd19caffa289 tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] [instance: deb54068-874d-4b55-ab9c-777c53b1d707] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:36:53.087497 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-70112f1f-1b52-4aeb-b6d5-dd19caffa289 tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:53.088225 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-70112f1f-1b52-4aeb-b6d5-dd19caffa289 tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:53.089244 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-70112f1f-1b52-4aeb-b6d5-dd19caffa289 tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:53.089750 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-70112f1f-1b52-4aeb-b6d5-dd19caffa289 tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:53.158472 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-70112f1f-1b52-4aeb-b6d5-dd19caffa289 tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498146f6a6814129b393e7084057bfd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db07feb3a43432999da539b6b85fb2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:36:53.166076 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-70112f1f-1b52-4aeb-b6d5-dd19caffa289 tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] 10.222.0.45 "GET /compute/v2.1/servers/deb54068-874d-4b55-ab9c-777c53b1d707" status: 200 len: 1276 microversion: 2.1 time: 0.091486 Jan 21 09:36:53.166652 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 93/196] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:36:53 2022] GET /compute/v2.1/servers/deb54068-874d-4b55-ab9c-777c53b1d707 => generated 1276 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:36:53.397923 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-9dde1d87-7125-421d-86c5-dc6f17a40210 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:36:53.398606 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-9dde1d87-7125-421d-86c5-dc6f17a40210 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] [instance: 06ae865a-6ba5-4198-be6d-e6056e645411] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:36:53.406470 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-9dde1d87-7125-421d-86c5-dc6f17a40210 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:53.407018 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-9dde1d87-7125-421d-86c5-dc6f17a40210 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:53.407889 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-9dde1d87-7125-421d-86c5-dc6f17a40210 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:53.408542 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-9dde1d87-7125-421d-86c5-dc6f17a40210 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:53.486944 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-bb4ff45a-0a80-4796-9e44-524279cec3da tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:36:53.488134 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-bb4ff45a-0a80-4796-9e44-524279cec3da tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] [instance: 59ad64a5-af93-44ef-8031-fd2f2d18a901] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:36:53.497459 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-bb4ff45a-0a80-4796-9e44-524279cec3da tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:53.498006 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-bb4ff45a-0a80-4796-9e44-524279cec3da tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:53.498890 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-bb4ff45a-0a80-4796-9e44-524279cec3da tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:53.499559 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-bb4ff45a-0a80-4796-9e44-524279cec3da tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:53.654005 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-bb4ff45a-0a80-4796-9e44-524279cec3da tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "POST /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901/action" status: 200 len: 14185 microversion: 2.20 time: 0.170751 Jan 21 09:36:53.655994 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 94/197] 10.222.0.45 () {62 vars in 1318 bytes} [Fri Jan 21 09:36:53 2022] POST /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901/action => generated 14185 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 21 09:36:53.689440 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-9dde1d87-7125-421d-86c5-dc6f17a40210 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db87258db1424ce7a8399fdd05efe3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89d1b21ad8471a8a9a82adac2594c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:36:53.698705 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-9dde1d87-7125-421d-86c5-dc6f17a40210 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] 10.222.0.45 "GET /compute/v2.1/servers/06ae865a-6ba5-4198-be6d-e6056e645411" status: 200 len: 1522 microversion: 2.1 time: 0.305469 Jan 21 09:36:53.699301 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 104/198] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:36:53 2022] GET /compute/v2.1/servers/06ae865a-6ba5-4198-be6d-e6056e645411 => generated 1522 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:36:53.727047 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-49040f51-8a72-4437-8b37-3f661268f118 tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:36:53.727744 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-49040f51-8a72-4437-8b37-3f661268f118 tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] [instance: b50feb40-c691-4724-8570-f5873bdc5d1e] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:36:53.756028 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-49040f51-8a72-4437-8b37-3f661268f118 tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:53.756726 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-49040f51-8a72-4437-8b37-3f661268f118 tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:53.758176 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-49040f51-8a72-4437-8b37-3f661268f118 tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:53.758609 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-49040f51-8a72-4437-8b37-3f661268f118 tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:54.135896 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-49040f51-8a72-4437-8b37-3f661268f118 tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b547a45bb54a8f94e9e5f5aeba7520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a31f7136c241578473d4d323722c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:36:54.150630 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-49040f51-8a72-4437-8b37-3f661268f118 tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] 10.222.0.45 "GET /compute/v2.1/servers/b50feb40-c691-4724-8570-f5873bdc5d1e" status: 200 len: 1553 microversion: 2.1 time: 0.422482 Jan 21 09:36:54.150630 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 95/199] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:36:53 2022] GET /compute/v2.1/servers/b50feb40-c691-4724-8570-f5873bdc5d1e => generated 1553 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:36:54.189332 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-ac16b05c-2a64-4c4c-ae61-098b8780268c tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:36:54.190582 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-ac16b05c-2a64-4c4c-ae61-098b8780268c tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] [instance: deb54068-874d-4b55-ab9c-777c53b1d707] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:36:54.201986 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-ac16b05c-2a64-4c4c-ae61-098b8780268c tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:54.202719 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-ac16b05c-2a64-4c4c-ae61-098b8780268c tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:54.203964 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-ac16b05c-2a64-4c4c-ae61-098b8780268c tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:54.204889 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-ac16b05c-2a64-4c4c-ae61-098b8780268c tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:54.639244 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-ac16b05c-2a64-4c4c-ae61-098b8780268c tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498146f6a6814129b393e7084057bfd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db07feb3a43432999da539b6b85fb2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:36:54.648760 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-ac16b05c-2a64-4c4c-ae61-098b8780268c tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] 10.222.0.45 "GET /compute/v2.1/servers/deb54068-874d-4b55-ab9c-777c53b1d707" status: 200 len: 1318 microversion: 2.1 time: 0.467966 Jan 21 09:36:54.649934 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 105/200] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:36:54 2022] GET /compute/v2.1/servers/deb54068-874d-4b55-ab9c-777c53b1d707 => generated 1318 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:36:54.666501 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-07593177-d3de-431e-bcfc-36631cd02fb2 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:36:54.667455 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-07593177-d3de-431e-bcfc-36631cd02fb2 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] [instance: 59ad64a5-af93-44ef-8031-fd2f2d18a901] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:36:54.677969 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-07593177-d3de-431e-bcfc-36631cd02fb2 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:54.678691 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-07593177-d3de-431e-bcfc-36631cd02fb2 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:54.680368 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-07593177-d3de-431e-bcfc-36631cd02fb2 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:54.685681 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-07593177-d3de-431e-bcfc-36631cd02fb2 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:54.717196 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-d7160fb1-1edd-4527-a0f7-e181ab2b7a9a tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:36:54.719189 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-d7160fb1-1edd-4527-a0f7-e181ab2b7a9a tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] [instance: 06ae865a-6ba5-4198-be6d-e6056e645411] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:36:54.733138 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-d7160fb1-1edd-4527-a0f7-e181ab2b7a9a tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:54.734421 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-d7160fb1-1edd-4527-a0f7-e181ab2b7a9a tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:54.735434 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-d7160fb1-1edd-4527-a0f7-e181ab2b7a9a tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:54.736193 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-d7160fb1-1edd-4527-a0f7-e181ab2b7a9a tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:54.793009 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-07593177-d3de-431e-bcfc-36631cd02fb2 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "POST /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901/action" status: 200 len: 17841 microversion: 2.20 time: 0.130274 Jan 21 09:36:54.793683 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 96/201] 10.222.0.45 () {62 vars in 1318 bytes} [Fri Jan 21 09:36:54 2022] POST /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901/action => generated 17841 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 21 09:36:54.886146 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [req-59e0f47d-95eb-462d-9665-3c2a093afb2c req-4802e459-15a5-4db9-af2a-3ac9646bbe28 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "deb54068-874d-4b55-ab9c-777c53b1d707", "tag": "14aab43b-4ab3-4c41-bc46-826e868d0936"}]} {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:36:54.887747 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 21 09:36:54.887747 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: warnings.warn(msg) Jan 21 09:36:54.895587 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [req-59e0f47d-95eb-462d-9665-3c2a093afb2c req-4802e459-15a5-4db9-af2a-3ac9646bbe28 service nova] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:54.896622 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [req-59e0f47d-95eb-462d-9665-3c2a093afb2c req-4802e459-15a5-4db9-af2a-3ac9646bbe28 service nova] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:54.914062 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.compute.server_external_events [req-59e0f47d-95eb-462d-9665-3c2a093afb2c req-4802e459-15a5-4db9-af2a-3ac9646bbe28 service nova] Creating event network-changed:14aab43b-4ab3-4c41-bc46-826e868d0936 for instance deb54068-874d-4b55-ab9c-777c53b1d707 on hv-cinder-80403 Jan 21 09:36:54.919504 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [req-59e0f47d-95eb-462d-9665-3c2a093afb2c req-4802e459-15a5-4db9-af2a-3ac9646bbe28 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037572 Jan 21 09:36:54.921021 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 97/202] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Jan 21 09:36:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 21 09:36:55.134290 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-d7160fb1-1edd-4527-a0f7-e181ab2b7a9a tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db87258db1424ce7a8399fdd05efe3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89d1b21ad8471a8a9a82adac2594c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:36:55.143674 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-d7160fb1-1edd-4527-a0f7-e181ab2b7a9a tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] 10.222.0.45 "GET /compute/v2.1/servers/06ae865a-6ba5-4198-be6d-e6056e645411" status: 200 len: 1522 microversion: 2.1 time: 0.430895 Jan 21 09:36:55.157350 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 106/203] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:36:54 2022] GET /compute/v2.1/servers/06ae865a-6ba5-4198-be6d-e6056e645411 => generated 1522 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:36:55.165602 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-aa3654dc-d2af-4f74-b4e5-ad81a15bcc43 tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:36:55.166357 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-aa3654dc-d2af-4f74-b4e5-ad81a15bcc43 tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] [instance: b50feb40-c691-4724-8570-f5873bdc5d1e] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:36:55.173757 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-aa3654dc-d2af-4f74-b4e5-ad81a15bcc43 tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:55.174577 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-aa3654dc-d2af-4f74-b4e5-ad81a15bcc43 tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:55.175667 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-aa3654dc-d2af-4f74-b4e5-ad81a15bcc43 tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:55.176325 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-aa3654dc-d2af-4f74-b4e5-ad81a15bcc43 tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:55.499772 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-aa3654dc-d2af-4f74-b4e5-ad81a15bcc43 tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b547a45bb54a8f94e9e5f5aeba7520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a31f7136c241578473d4d323722c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:36:55.509176 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-aa3654dc-d2af-4f74-b4e5-ad81a15bcc43 tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] 10.222.0.45 "GET /compute/v2.1/servers/b50feb40-c691-4724-8570-f5873bdc5d1e" status: 200 len: 1511 microversion: 2.1 time: 0.350343 Jan 21 09:36:55.510338 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 98/204] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:36:55 2022] GET /compute/v2.1/servers/b50feb40-c691-4724-8570-f5873bdc5d1e => generated 1511 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:36:55.666048 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-1eb2db4d-af0f-4a3f-9f8a-898c865bf176 tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:36:55.667275 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-1eb2db4d-af0f-4a3f-9f8a-898c865bf176 tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] [instance: deb54068-874d-4b55-ab9c-777c53b1d707] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:36:55.674821 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-1eb2db4d-af0f-4a3f-9f8a-898c865bf176 tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:55.676898 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-1eb2db4d-af0f-4a3f-9f8a-898c865bf176 tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:55.678347 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-1eb2db4d-af0f-4a3f-9f8a-898c865bf176 tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:55.678944 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-1eb2db4d-af0f-4a3f-9f8a-898c865bf176 tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:55.841896 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-71901b1c-5460-4517-accc-84fc7c97b1ad tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:36:55.841896 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-71901b1c-5460-4517-accc-84fc7c97b1ad tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] [instance: 59ad64a5-af93-44ef-8031-fd2f2d18a901] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:36:55.841896 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-71901b1c-5460-4517-accc-84fc7c97b1ad tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:55.841896 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-71901b1c-5460-4517-accc-84fc7c97b1ad tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:55.844038 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-71901b1c-5460-4517-accc-84fc7c97b1ad tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:55.844038 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-71901b1c-5460-4517-accc-84fc7c97b1ad tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:55.936142 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-71901b1c-5460-4517-accc-84fc7c97b1ad tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "POST /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901/action" status: 200 len: 17960 microversion: 2.20 time: 0.135544 Jan 21 09:36:55.936820 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 99/205] 10.222.0.45 () {62 vars in 1318 bytes} [Fri Jan 21 09:36:55 2022] POST /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901/action => generated 17960 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 21 09:36:55.966021 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-1eb2db4d-af0f-4a3f-9f8a-898c865bf176 tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498146f6a6814129b393e7084057bfd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db07feb3a43432999da539b6b85fb2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:36:55.973751 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-1eb2db4d-af0f-4a3f-9f8a-898c865bf176 tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] 10.222.0.45 "GET /compute/v2.1/servers/deb54068-874d-4b55-ab9c-777c53b1d707" status: 200 len: 1318 microversion: 2.1 time: 0.311881 Jan 21 09:36:55.974924 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 107/206] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:36:55 2022] GET /compute/v2.1/servers/deb54068-874d-4b55-ab9c-777c53b1d707 => generated 1318 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:36:56.161952 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-35fee99d-a132-4918-81f4-2f7f3dedf729 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:36:56.163076 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-35fee99d-a132-4918-81f4-2f7f3dedf729 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] [instance: 06ae865a-6ba5-4198-be6d-e6056e645411] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:36:56.177333 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-35fee99d-a132-4918-81f4-2f7f3dedf729 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:56.177333 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-35fee99d-a132-4918-81f4-2f7f3dedf729 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:56.177333 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-35fee99d-a132-4918-81f4-2f7f3dedf729 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:56.177333 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-35fee99d-a132-4918-81f4-2f7f3dedf729 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:56.401875 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-35fee99d-a132-4918-81f4-2f7f3dedf729 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db87258db1424ce7a8399fdd05efe3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89d1b21ad8471a8a9a82adac2594c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:36:56.401875 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-35fee99d-a132-4918-81f4-2f7f3dedf729 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] 10.222.0.45 "GET /compute/v2.1/servers/06ae865a-6ba5-4198-be6d-e6056e645411" status: 200 len: 1522 microversion: 2.1 time: 0.243341 Jan 21 09:36:56.402298 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 100/207] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:36:56 2022] GET /compute/v2.1/servers/06ae865a-6ba5-4198-be6d-e6056e645411 => generated 1522 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:36:56.526962 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-26a66d67-494c-4ff9-ac1e-48625fe7aff0 tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:36:56.527568 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-26a66d67-494c-4ff9-ac1e-48625fe7aff0 tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] [instance: b50feb40-c691-4724-8570-f5873bdc5d1e] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:36:56.533620 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-26a66d67-494c-4ff9-ac1e-48625fe7aff0 tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:56.538813 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-26a66d67-494c-4ff9-ac1e-48625fe7aff0 tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:56.538813 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-26a66d67-494c-4ff9-ac1e-48625fe7aff0 tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:56.538813 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-26a66d67-494c-4ff9-ac1e-48625fe7aff0 tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:56.567342 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-26a66d67-494c-4ff9-ac1e-48625fe7aff0 tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:56.567881 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-26a66d67-494c-4ff9-ac1e-48625fe7aff0 tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:56.569032 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.objects.instance [None req-26a66d67-494c-4ff9-ac1e-48625fe7aff0 tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Lazy-loading 'fault' on Instance uuid b50feb40-c691-4724-8570-f5873bdc5d1e {{(pid=123387) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 21 09:36:56.625733 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-26a66d67-494c-4ff9-ac1e-48625fe7aff0 tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83b547a45bb54a8f94e9e5f5aeba7520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '22a31f7136c241578473d4d323722c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:36:56.642890 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-26a66d67-494c-4ff9-ac1e-48625fe7aff0 tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] 10.222.0.45 "GET /compute/v2.1/servers/b50feb40-c691-4724-8570-f5873bdc5d1e" status: 200 len: 1351 microversion: 2.1 time: 0.119425 Jan 21 09:36:56.643609 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 108/208] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:36:56 2022] GET /compute/v2.1/servers/b50feb40-c691-4724-8570-f5873bdc5d1e => generated 1351 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:36:56.948703 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-b872e1e3-c881-45b1-849e-38bf145a0dce tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:36:56.954654 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-b872e1e3-c881-45b1-849e-38bf145a0dce tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] [instance: 59ad64a5-af93-44ef-8031-fd2f2d18a901] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:36:56.955159 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [req-9d82b23e-7b99-4c8f-a24f-24202e126c02 req-c266347d-9f4c-4a10-bbbb-b4a597ecb349 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b50feb40-c691-4724-8570-f5873bdc5d1e", "name": "network-vif-deleted", "tag": "dde72027-8017-427e-a871-c6be683d8168"}]} {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:36:56.956840 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 21 09:36:56.956840 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: warnings.warn(msg) Jan 21 09:36:56.961329 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-b872e1e3-c881-45b1-849e-38bf145a0dce tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:56.961644 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-b872e1e3-c881-45b1-849e-38bf145a0dce tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:56.962470 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-b872e1e3-c881-45b1-849e-38bf145a0dce tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:56.962880 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-b872e1e3-c881-45b1-849e-38bf145a0dce tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:56.966614 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [req-9d82b23e-7b99-4c8f-a24f-24202e126c02 req-c266347d-9f4c-4a10-bbbb-b4a597ecb349 service nova] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:56.967308 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [req-9d82b23e-7b99-4c8f-a24f-24202e126c02 req-c266347d-9f4c-4a10-bbbb-b4a597ecb349 service nova] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:56.979624 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.compute.server_external_events [req-9d82b23e-7b99-4c8f-a24f-24202e126c02 req-c266347d-9f4c-4a10-bbbb-b4a597ecb349 service nova] Creating event network-vif-deleted:dde72027-8017-427e-a871-c6be683d8168 for instance b50feb40-c691-4724-8570-f5873bdc5d1e on hv-cinder-80403 Jan 21 09:36:56.985562 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [req-9d82b23e-7b99-4c8f-a24f-24202e126c02 req-c266347d-9f4c-4a10-bbbb-b4a597ecb349 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035416 Jan 21 09:36:56.989239 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 109/209] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Jan 21 09:36:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 21 09:36:56.996773 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-ad985b02-5aea-40d9-81db-73cd1fb79e25 tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:36:56.997503 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-ad985b02-5aea-40d9-81db-73cd1fb79e25 tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] [instance: deb54068-874d-4b55-ab9c-777c53b1d707] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:36:57.004409 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-ad985b02-5aea-40d9-81db-73cd1fb79e25 tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:57.004853 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-ad985b02-5aea-40d9-81db-73cd1fb79e25 tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:57.006144 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-ad985b02-5aea-40d9-81db-73cd1fb79e25 tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:57.006585 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-ad985b02-5aea-40d9-81db-73cd1fb79e25 tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:57.060073 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-b872e1e3-c881-45b1-849e-38bf145a0dce tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "POST /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901/action" status: 200 len: 19133 microversion: 2.20 time: 0.114604 Jan 21 09:36:57.060372 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 101/210] 10.222.0.45 () {62 vars in 1318 bytes} [Fri Jan 21 09:36:56 2022] POST /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901/action => generated 19133 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 21 09:36:57.146709 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-ad985b02-5aea-40d9-81db-73cd1fb79e25 tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498146f6a6814129b393e7084057bfd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db07feb3a43432999da539b6b85fb2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:36:57.154112 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-ad985b02-5aea-40d9-81db-73cd1fb79e25 tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] 10.222.0.45 "GET /compute/v2.1/servers/deb54068-874d-4b55-ab9c-777c53b1d707" status: 200 len: 1318 microversion: 2.1 time: 0.161834 Jan 21 09:36:57.154700 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 110/211] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:36:56 2022] GET /compute/v2.1/servers/deb54068-874d-4b55-ab9c-777c53b1d707 => generated 1318 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:36:57.418756 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-3aa8ab34-cf3e-4b67-83a2-7aafdbfea707 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:36:57.419464 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-3aa8ab34-cf3e-4b67-83a2-7aafdbfea707 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] [instance: 06ae865a-6ba5-4198-be6d-e6056e645411] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:36:57.426597 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-3aa8ab34-cf3e-4b67-83a2-7aafdbfea707 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:57.427111 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-3aa8ab34-cf3e-4b67-83a2-7aafdbfea707 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:57.428632 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-3aa8ab34-cf3e-4b67-83a2-7aafdbfea707 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:57.429106 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-3aa8ab34-cf3e-4b67-83a2-7aafdbfea707 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:57.585425 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-3aa8ab34-cf3e-4b67-83a2-7aafdbfea707 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db87258db1424ce7a8399fdd05efe3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89d1b21ad8471a8a9a82adac2594c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:36:57.593381 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-3aa8ab34-cf3e-4b67-83a2-7aafdbfea707 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] 10.222.0.45 "GET /compute/v2.1/servers/06ae865a-6ba5-4198-be6d-e6056e645411" status: 200 len: 1522 microversion: 2.1 time: 0.178524 Jan 21 09:36:57.593950 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 102/212] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:36:57 2022] GET /compute/v2.1/servers/06ae865a-6ba5-4198-be6d-e6056e645411 => generated 1522 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:36:57.661088 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-8ea39422-d487-40b1-9ac0-9e068f4eda2c tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:36:57.662476 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-8ea39422-d487-40b1-9ac0-9e068f4eda2c tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] [instance: b50feb40-c691-4724-8570-f5873bdc5d1e] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:36:57.668910 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-8ea39422-d487-40b1-9ac0-9e068f4eda2c tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:57.669413 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-8ea39422-d487-40b1-9ac0-9e068f4eda2c tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:57.670209 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-8ea39422-d487-40b1-9ac0-9e068f4eda2c tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:57.670632 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-8ea39422-d487-40b1-9ac0-9e068f4eda2c tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:57.686880 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.wsgi [None req-8ea39422-d487-40b1-9ac0-9e068f4eda2c tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] HTTP exception thrown: Instance b50feb40-c691-4724-8570-f5873bdc5d1e could not be found. Jan 21 09:36:57.687379 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-8ea39422-d487-40b1-9ac0-9e068f4eda2c tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Returning 404 to user: Instance b50feb40-c691-4724-8570-f5873bdc5d1e could not be found. {{(pid=123387) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 21 09:36:57.688341 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-8ea39422-d487-40b1-9ac0-9e068f4eda2c tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] 10.222.0.45 "GET /compute/v2.1/servers/b50feb40-c691-4724-8570-f5873bdc5d1e" status: 404 len: 111 microversion: 2.1 time: 0.031369 Jan 21 09:36:57.688911 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 111/213] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:36:57 2022] GET /compute/v2.1/servers/b50feb40-c691-4724-8570-f5873bdc5d1e => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 21 09:36:57.818797 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-99d668d8-d31a-431e-af58-e2e4ee4cf2aa tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:36:57.819789 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-99d668d8-d31a-431e-af58-e2e4ee4cf2aa tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] [instance: b50feb40-c691-4724-8570-f5873bdc5d1e] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:36:57.829024 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-99d668d8-d31a-431e-af58-e2e4ee4cf2aa tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:57.829659 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-99d668d8-d31a-431e-af58-e2e4ee4cf2aa tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:57.831127 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-99d668d8-d31a-431e-af58-e2e4ee4cf2aa tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:57.831567 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-99d668d8-d31a-431e-af58-e2e4ee4cf2aa tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:57.850329 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.wsgi [None req-99d668d8-d31a-431e-af58-e2e4ee4cf2aa tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] HTTP exception thrown: Instance b50feb40-c691-4724-8570-f5873bdc5d1e could not be found. Jan 21 09:36:57.850856 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-99d668d8-d31a-431e-af58-e2e4ee4cf2aa tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Returning 404 to user: Instance b50feb40-c691-4724-8570-f5873bdc5d1e could not be found. {{(pid=123386) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 21 09:36:57.851689 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-99d668d8-d31a-431e-af58-e2e4ee4cf2aa tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] 10.222.0.45 "GET /compute/v2.1/servers/b50feb40-c691-4724-8570-f5873bdc5d1e/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.038887 Jan 21 09:36:57.852590 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 103/214] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Jan 21 09:36:57 2022] GET /compute/v2.1/servers/b50feb40-c691-4724-8570-f5873bdc5d1e/os-volume_attachments => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 21 09:36:57.979623 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-d9ce3fba-35d0-4650-9f57-02ec2ec7a376 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1600968811", "imageRef": "813e53ee-82e7-4a13-9f63-a8be7b1089f1", "flavorRef": "452", "networks": [{"uuid": "6d3bfab5-614b-42ce-87b9-03bdb3f3c1da"}]}} {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:36:58.032204 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.network.neutron [None req-d9ce3fba-35d0-4650-9f57-02ec2ec7a376 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] validate_networks() for [('6d3bfab5-614b-42ce-87b9-03bdb3f3c1da', None, None, None, None, None)] {{(pid=123387) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 21 09:36:58.071797 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-8a9da936-dbb7-4013-a5d8-50fa9c4120ea tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:36:58.079442 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-8a9da936-dbb7-4013-a5d8-50fa9c4120ea tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] [instance: 59ad64a5-af93-44ef-8031-fd2f2d18a901] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:36:58.079993 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-8a9da936-dbb7-4013-a5d8-50fa9c4120ea tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:58.080448 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-8a9da936-dbb7-4013-a5d8-50fa9c4120ea tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:58.081281 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-8a9da936-dbb7-4013-a5d8-50fa9c4120ea tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:58.081734 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-8a9da936-dbb7-4013-a5d8-50fa9c4120ea tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:58.439763 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.virt.hardware [None req-d9ce3fba-35d0-4650-9f57-02ec2ec7a376 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Flavor limits 0:0:0 {{(pid=123387) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 21 09:36:58.440194 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.virt.hardware [None req-d9ce3fba-35d0-4650-9f57-02ec2ec7a376 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Image limits 0:0:0 {{(pid=123387) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 21 09:36:58.440663 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.virt.hardware [None req-d9ce3fba-35d0-4650-9f57-02ec2ec7a376 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Flavor pref 0:0:0 {{(pid=123387) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 21 09:36:58.441067 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.virt.hardware [None req-d9ce3fba-35d0-4650-9f57-02ec2ec7a376 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Image pref 0:0:0 {{(pid=123387) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 21 09:36:58.441500 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.virt.hardware [None req-d9ce3fba-35d0-4650-9f57-02ec2ec7a376 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123387) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 21 09:36:58.451624 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-d9ce3fba-35d0-4650-9f57-02ec2ec7a376 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:58.452066 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-d9ce3fba-35d0-4650-9f57-02ec2ec7a376 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:58.452876 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-d9ce3fba-35d0-4650-9f57-02ec2ec7a376 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:58.453336 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-d9ce3fba-35d0-4650-9f57-02ec2ec7a376 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:58.470905 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.quota [None req-d9ce3fba-35d0-4650-9f57-02ec2ec7a376 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Getting quotas for project e3390729231b409e9a83376b428c1a7f. Resources: {'cores', 'instances', 'ram'} {{(pid=123387) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 21 09:36:58.475306 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.quota [None req-d9ce3fba-35d0-4650-9f57-02ec2ec7a376 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Getting quotas for user fc7b2c14d9444d65ab7a874e749671bb and project e3390729231b409e9a83376b428c1a7f. Resources: {'cores', 'instances', 'ram'} {{(pid=123387) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 21 09:36:58.486491 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-d9ce3fba-35d0-4650-9f57-02ec2ec7a376 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Going to run 1 instances... {{(pid=123387) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 21 09:36:58.489076 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-d9ce3fba-35d0-4650-9f57-02ec2ec7a376 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] [instance: bc1c3d0f-0474-4bad-b8a1-7c7d169b6ad0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='813e53ee-82e7-4a13-9f63-a8be7b1089f1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123387) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 21 09:36:58.687597 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-d9ce3fba-35d0-4650-9f57-02ec2ec7a376 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.711550 Jan 21 09:36:58.688170 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 112/215] 10.222.0.45 () {60 vars in 1146 bytes} [Fri Jan 21 09:36:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 713 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 21 09:36:58.693986 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-cb06a0e8-ce7c-4c57-8dae-f29a975d2826 tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:36:58.694690 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-cb06a0e8-ce7c-4c57-8dae-f29a975d2826 tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] [instance: deb54068-874d-4b55-ab9c-777c53b1d707] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:36:58.701869 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-cb06a0e8-ce7c-4c57-8dae-f29a975d2826 tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:58.702319 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-cb06a0e8-ce7c-4c57-8dae-f29a975d2826 tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:58.703339 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-cb06a0e8-ce7c-4c57-8dae-f29a975d2826 tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:58.703969 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-cb06a0e8-ce7c-4c57-8dae-f29a975d2826 tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:58.865508 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-cb06a0e8-ce7c-4c57-8dae-f29a975d2826 tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498146f6a6814129b393e7084057bfd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db07feb3a43432999da539b6b85fb2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:36:58.875273 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-cb06a0e8-ce7c-4c57-8dae-f29a975d2826 tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] 10.222.0.45 "GET /compute/v2.1/servers/deb54068-874d-4b55-ab9c-777c53b1d707" status: 200 len: 1318 microversion: 2.1 time: 0.185340 Jan 21 09:36:58.876558 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 113/216] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:36:58 2022] GET /compute/v2.1/servers/deb54068-874d-4b55-ab9c-777c53b1d707 => generated 1318 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:36:58.882597 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-267e4978-cb2b-4ff6-bb91-a7cddd670e4e tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:36:58.883464 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-267e4978-cb2b-4ff6-bb91-a7cddd670e4e tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] [instance: 06ae865a-6ba5-4198-be6d-e6056e645411] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:36:58.890045 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-267e4978-cb2b-4ff6-bb91-a7cddd670e4e tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:58.890720 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-267e4978-cb2b-4ff6-bb91-a7cddd670e4e tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:58.891701 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-267e4978-cb2b-4ff6-bb91-a7cddd670e4e tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:58.892285 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-267e4978-cb2b-4ff6-bb91-a7cddd670e4e tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:59.038037 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-267e4978-cb2b-4ff6-bb91-a7cddd670e4e tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db87258db1424ce7a8399fdd05efe3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89d1b21ad8471a8a9a82adac2594c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:36:59.046698 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-267e4978-cb2b-4ff6-bb91-a7cddd670e4e tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] 10.222.0.45 "GET /compute/v2.1/servers/06ae865a-6ba5-4198-be6d-e6056e645411" status: 200 len: 1522 microversion: 2.1 time: 0.168108 Jan 21 09:36:59.047287 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 114/217] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:36:58 2022] GET /compute/v2.1/servers/06ae865a-6ba5-4198-be6d-e6056e645411 => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:36:59.053253 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-60c62a94-0514-4ad7-8619-f084a91c1069 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:36:59.054650 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-60c62a94-0514-4ad7-8619-f084a91c1069 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] [instance: bc1c3d0f-0474-4bad-b8a1-7c7d169b6ad0] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:36:59.108265 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-60c62a94-0514-4ad7-8619-f084a91c1069 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7b2c14d9444d65ab7a874e749671bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3390729231b409e9a83376b428c1a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:36:59.116585 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-60c62a94-0514-4ad7-8619-f084a91c1069 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] 10.222.0.45 "GET /compute/v2.1/servers/bc1c3d0f-0474-4bad-b8a1-7c7d169b6ad0" status: 200 len: 1218 microversion: 2.1 time: 0.067837 Jan 21 09:36:59.118120 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 115/218] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:36:59 2022] GET /compute/v2.1/servers/bc1c3d0f-0474-4bad-b8a1-7c7d169b6ad0 => generated 1218 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:36:59.893464 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-015c1fa0-cacb-4d52-8c7d-b9639c9fb77a tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:36:59.894378 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-015c1fa0-cacb-4d52-8c7d-b9639c9fb77a tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] [instance: deb54068-874d-4b55-ab9c-777c53b1d707] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:36:59.901898 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-015c1fa0-cacb-4d52-8c7d-b9639c9fb77a tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:59.903348 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-015c1fa0-cacb-4d52-8c7d-b9639c9fb77a tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:36:59.903539 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-015c1fa0-cacb-4d52-8c7d-b9639c9fb77a tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:36:59.903908 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-015c1fa0-cacb-4d52-8c7d-b9639c9fb77a tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:00.071917 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-015c1fa0-cacb-4d52-8c7d-b9639c9fb77a tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498146f6a6814129b393e7084057bfd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db07feb3a43432999da539b6b85fb2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:37:00.080049 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-015c1fa0-cacb-4d52-8c7d-b9639c9fb77a tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] 10.222.0.45 "GET /compute/v2.1/servers/deb54068-874d-4b55-ab9c-777c53b1d707" status: 200 len: 1318 microversion: 2.1 time: 0.190236 Jan 21 09:37:00.080630 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 116/219] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:36:59 2022] GET /compute/v2.1/servers/deb54068-874d-4b55-ab9c-777c53b1d707 => generated 1318 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 09:37:00.086047 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-fbd2e1df-a0e9-4909-9f58-eb24e051fa4b tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:37:00.086657 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-fbd2e1df-a0e9-4909-9f58-eb24e051fa4b tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] [instance: 06ae865a-6ba5-4198-be6d-e6056e645411] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:37:00.092521 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-fbd2e1df-a0e9-4909-9f58-eb24e051fa4b tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:00.092974 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-fbd2e1df-a0e9-4909-9f58-eb24e051fa4b tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:00.093982 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-fbd2e1df-a0e9-4909-9f58-eb24e051fa4b tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:00.094432 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-fbd2e1df-a0e9-4909-9f58-eb24e051fa4b tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:00.271169 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-fbd2e1df-a0e9-4909-9f58-eb24e051fa4b tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db87258db1424ce7a8399fdd05efe3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89d1b21ad8471a8a9a82adac2594c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:37:00.284029 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-fbd2e1df-a0e9-4909-9f58-eb24e051fa4b tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] 10.222.0.45 "GET /compute/v2.1/servers/06ae865a-6ba5-4198-be6d-e6056e645411" status: 200 len: 1522 microversion: 2.1 time: 0.201625 Jan 21 09:37:00.285630 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 117/220] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:37:00 2022] GET /compute/v2.1/servers/06ae865a-6ba5-4198-be6d-e6056e645411 => generated 1522 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:37:00.300398 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-dd43d29a-e2d8-4f31-aec6-0f591830bc42 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:37:00.301039 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-dd43d29a-e2d8-4f31-aec6-0f591830bc42 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] [instance: bc1c3d0f-0474-4bad-b8a1-7c7d169b6ad0] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:37:00.307121 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-dd43d29a-e2d8-4f31-aec6-0f591830bc42 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:00.307703 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-dd43d29a-e2d8-4f31-aec6-0f591830bc42 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:00.308342 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-dd43d29a-e2d8-4f31-aec6-0f591830bc42 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:00.308775 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-dd43d29a-e2d8-4f31-aec6-0f591830bc42 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:00.373920 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-dd43d29a-e2d8-4f31-aec6-0f591830bc42 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7b2c14d9444d65ab7a874e749671bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3390729231b409e9a83376b428c1a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:37:00.382035 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-dd43d29a-e2d8-4f31-aec6-0f591830bc42 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] 10.222.0.45 "GET /compute/v2.1/servers/bc1c3d0f-0474-4bad-b8a1-7c7d169b6ad0" status: 200 len: 1222 microversion: 2.1 time: 0.095086 Jan 21 09:37:00.382626 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 118/221] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:37:00 2022] GET /compute/v2.1/servers/bc1c3d0f-0474-4bad-b8a1-7c7d169b6ad0 => generated 1222 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:37:00.661889 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-8a9da936-dbb7-4013-a5d8-50fa9c4120ea tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "POST /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901/action" status: 200 len: 22974 microversion: 2.20 time: 2.593461 Jan 21 09:37:00.663469 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 104/222] 10.222.0.45 () {62 vars in 1318 bytes} [Fri Jan 21 09:36:58 2022] POST /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901/action => generated 22974 bytes in 2596 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 21 09:37:01.104939 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-87b0886d-da94-49f0-9604-4bac3a020848 tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:37:01.106383 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-87b0886d-da94-49f0-9604-4bac3a020848 tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] [instance: deb54068-874d-4b55-ab9c-777c53b1d707] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:37:01.121096 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-87b0886d-da94-49f0-9604-4bac3a020848 tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:01.121883 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-87b0886d-da94-49f0-9604-4bac3a020848 tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:01.122965 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-87b0886d-da94-49f0-9604-4bac3a020848 tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:01.123857 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-87b0886d-da94-49f0-9604-4bac3a020848 tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:01.279374 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-87b0886d-da94-49f0-9604-4bac3a020848 tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498146f6a6814129b393e7084057bfd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db07feb3a43432999da539b6b85fb2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:37:01.288157 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-87b0886d-da94-49f0-9604-4bac3a020848 tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] 10.222.0.45 "GET /compute/v2.1/servers/deb54068-874d-4b55-ab9c-777c53b1d707" status: 200 len: 1318 microversion: 2.1 time: 0.188425 Jan 21 09:37:01.298331 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 119/223] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:37:01 2022] GET /compute/v2.1/servers/deb54068-874d-4b55-ab9c-777c53b1d707 => generated 1318 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:37:01.308727 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-56e2b485-505f-4945-9082-a578e3b590e3 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:37:01.311139 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-56e2b485-505f-4945-9082-a578e3b590e3 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] [instance: 06ae865a-6ba5-4198-be6d-e6056e645411] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:37:01.321689 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-56e2b485-505f-4945-9082-a578e3b590e3 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:01.322241 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-56e2b485-505f-4945-9082-a578e3b590e3 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:01.323263 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-56e2b485-505f-4945-9082-a578e3b590e3 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:01.323933 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-56e2b485-505f-4945-9082-a578e3b590e3 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:01.400180 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-3871166b-8933-487b-b559-732087710526 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:37:01.400807 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-3871166b-8933-487b-b559-732087710526 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] [instance: bc1c3d0f-0474-4bad-b8a1-7c7d169b6ad0] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:37:01.407611 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-3871166b-8933-487b-b559-732087710526 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:01.408055 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-3871166b-8933-487b-b559-732087710526 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:01.409933 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-3871166b-8933-487b-b559-732087710526 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:01.410555 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-3871166b-8933-487b-b559-732087710526 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:01.487804 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-3871166b-8933-487b-b559-732087710526 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7b2c14d9444d65ab7a874e749671bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3390729231b409e9a83376b428c1a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:37:01.496554 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-3871166b-8933-487b-b559-732087710526 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] 10.222.0.45 "GET /compute/v2.1/servers/bc1c3d0f-0474-4bad-b8a1-7c7d169b6ad0" status: 200 len: 1270 microversion: 2.1 time: 0.100875 Jan 21 09:37:01.502791 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 120/224] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:37:01 2022] GET /compute/v2.1/servers/bc1c3d0f-0474-4bad-b8a1-7c7d169b6ad0 => generated 1270 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 09:37:01.529494 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-56e2b485-505f-4945-9082-a578e3b590e3 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db87258db1424ce7a8399fdd05efe3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89d1b21ad8471a8a9a82adac2594c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:37:01.540247 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-56e2b485-505f-4945-9082-a578e3b590e3 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] 10.222.0.45 "GET /compute/v2.1/servers/06ae865a-6ba5-4198-be6d-e6056e645411" status: 200 len: 1522 microversion: 2.1 time: 0.240057 Jan 21 09:37:01.540821 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 105/225] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:37:01 2022] GET /compute/v2.1/servers/06ae865a-6ba5-4198-be6d-e6056e645411 => generated 1522 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:37:01.674694 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-3b9a0be6-45cc-4855-89eb-03fb2719bccf tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:37:01.676373 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-3b9a0be6-45cc-4855-89eb-03fb2719bccf tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] [instance: 59ad64a5-af93-44ef-8031-fd2f2d18a901] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:37:01.705306 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-3b9a0be6-45cc-4855-89eb-03fb2719bccf tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:01.705955 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-3b9a0be6-45cc-4855-89eb-03fb2719bccf tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:01.706953 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-3b9a0be6-45cc-4855-89eb-03fb2719bccf tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:01.707394 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-3b9a0be6-45cc-4855-89eb-03fb2719bccf tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:01.809432 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-3b9a0be6-45cc-4855-89eb-03fb2719bccf tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "POST /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901/action" status: 200 len: 23796 microversion: 2.20 time: 0.138524 Jan 21 09:37:01.810339 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 121/226] 10.222.0.45 () {62 vars in 1318 bytes} [Fri Jan 21 09:37:01 2022] POST /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901/action => generated 23796 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 21 09:37:02.306204 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-997f44cf-d812-426b-a072-bde6941c72e6 tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:37:02.306823 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-997f44cf-d812-426b-a072-bde6941c72e6 tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] [instance: deb54068-874d-4b55-ab9c-777c53b1d707] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:37:02.313391 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-997f44cf-d812-426b-a072-bde6941c72e6 tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:02.313844 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-997f44cf-d812-426b-a072-bde6941c72e6 tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:02.314646 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-997f44cf-d812-426b-a072-bde6941c72e6 tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:02.315283 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-997f44cf-d812-426b-a072-bde6941c72e6 tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:02.373508 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-8bbea96d-fbf1-4ed7-96f9-81b4738a679c tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:37:02.375178 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-8bbea96d-fbf1-4ed7-96f9-81b4738a679c tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] [instance: b50feb40-c691-4724-8570-f5873bdc5d1e] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:37:02.385795 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-8bbea96d-fbf1-4ed7-96f9-81b4738a679c tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:02.386833 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-8bbea96d-fbf1-4ed7-96f9-81b4738a679c tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:02.388021 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-8bbea96d-fbf1-4ed7-96f9-81b4738a679c tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:02.388613 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-8bbea96d-fbf1-4ed7-96f9-81b4738a679c tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:02.407251 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.wsgi [None req-8bbea96d-fbf1-4ed7-96f9-81b4738a679c tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] HTTP exception thrown: Instance b50feb40-c691-4724-8570-f5873bdc5d1e could not be found. Jan 21 09:37:02.408827 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-8bbea96d-fbf1-4ed7-96f9-81b4738a679c tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Returning 404 to user: Instance b50feb40-c691-4724-8570-f5873bdc5d1e could not be found. {{(pid=123387) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 21 09:37:02.412843 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-8bbea96d-fbf1-4ed7-96f9-81b4738a679c tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] 10.222.0.45 "DELETE /compute/v2.1/servers/b50feb40-c691-4724-8570-f5873bdc5d1e" status: 404 len: 111 microversion: 2.1 time: 0.041756 Jan 21 09:37:02.412843 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 122/227] 10.222.0.45 () {58 vars in 1238 bytes} [Fri Jan 21 09:37:02 2022] DELETE /compute/v2.1/servers/b50feb40-c691-4724-8570-f5873bdc5d1e => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 21 09:37:02.421398 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-08936450-eb0c-4551-8478-0bf8da26773f tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:37:02.421631 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-08936450-eb0c-4551-8478-0bf8da26773f tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] [instance: b50feb40-c691-4724-8570-f5873bdc5d1e] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:37:02.432547 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-08936450-eb0c-4551-8478-0bf8da26773f tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:02.432999 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-08936450-eb0c-4551-8478-0bf8da26773f tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:02.433947 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-08936450-eb0c-4551-8478-0bf8da26773f tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:02.434382 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-08936450-eb0c-4551-8478-0bf8da26773f tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:02.450441 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.wsgi [None req-08936450-eb0c-4551-8478-0bf8da26773f tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] HTTP exception thrown: Instance b50feb40-c691-4724-8570-f5873bdc5d1e could not be found. Jan 21 09:37:02.451042 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-08936450-eb0c-4551-8478-0bf8da26773f tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] Returning 404 to user: Instance b50feb40-c691-4724-8570-f5873bdc5d1e could not be found. {{(pid=123387) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 21 09:37:02.451895 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-08936450-eb0c-4551-8478-0bf8da26773f tempest-DeleteServersTestJSON-1321460479 tempest-DeleteServersTestJSON-1321460479-project] 10.222.0.45 "GET /compute/v2.1/servers/b50feb40-c691-4724-8570-f5873bdc5d1e" status: 404 len: 111 microversion: 2.1 time: 0.035306 Jan 21 09:37:02.452466 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 123/228] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:37:02 2022] GET /compute/v2.1/servers/b50feb40-c691-4724-8570-f5873bdc5d1e => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 21 09:37:02.519418 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-a4d94695-c2d3-41fc-887f-d2e5090548bd tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:37:02.520307 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-a4d94695-c2d3-41fc-887f-d2e5090548bd tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] [instance: bc1c3d0f-0474-4bad-b8a1-7c7d169b6ad0] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:37:02.532266 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-a4d94695-c2d3-41fc-887f-d2e5090548bd tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:02.534068 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-a4d94695-c2d3-41fc-887f-d2e5090548bd tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:02.535283 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-a4d94695-c2d3-41fc-887f-d2e5090548bd tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:02.535739 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-a4d94695-c2d3-41fc-887f-d2e5090548bd tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:02.589652 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-997f44cf-d812-426b-a072-bde6941c72e6 tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498146f6a6814129b393e7084057bfd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db07feb3a43432999da539b6b85fb2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:37:02.604242 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-997f44cf-d812-426b-a072-bde6941c72e6 tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] 10.222.0.45 "GET /compute/v2.1/servers/deb54068-874d-4b55-ab9c-777c53b1d707" status: 200 len: 1318 microversion: 2.1 time: 0.302474 Jan 21 09:37:02.607911 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 106/229] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:37:02 2022] GET /compute/v2.1/servers/deb54068-874d-4b55-ab9c-777c53b1d707 => generated 1318 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:37:02.622504 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-013bfc44-8d9f-4dba-b6fc-c8b9e4d5efcc tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:37:02.623135 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-013bfc44-8d9f-4dba-b6fc-c8b9e4d5efcc tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] [instance: 06ae865a-6ba5-4198-be6d-e6056e645411] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:37:02.635900 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-013bfc44-8d9f-4dba-b6fc-c8b9e4d5efcc tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:02.642959 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-013bfc44-8d9f-4dba-b6fc-c8b9e4d5efcc tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:02.642959 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-013bfc44-8d9f-4dba-b6fc-c8b9e4d5efcc tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:02.642959 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-013bfc44-8d9f-4dba-b6fc-c8b9e4d5efcc tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:02.709116 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-a4d94695-c2d3-41fc-887f-d2e5090548bd tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7b2c14d9444d65ab7a874e749671bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3390729231b409e9a83376b428c1a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:37:02.717709 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-a4d94695-c2d3-41fc-887f-d2e5090548bd tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] 10.222.0.45 "GET /compute/v2.1/servers/bc1c3d0f-0474-4bad-b8a1-7c7d169b6ad0" status: 200 len: 1276 microversion: 2.1 time: 0.201853 Jan 21 09:37:02.718611 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 124/230] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:37:02 2022] GET /compute/v2.1/servers/bc1c3d0f-0474-4bad-b8a1-7c7d169b6ad0 => generated 1276 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:37:02.822119 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-54086469-8dd9-4847-9dd6-8e51c9b4a7d4 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:37:02.824072 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-54086469-8dd9-4847-9dd6-8e51c9b4a7d4 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] [instance: 59ad64a5-af93-44ef-8031-fd2f2d18a901] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:37:02.830402 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-54086469-8dd9-4847-9dd6-8e51c9b4a7d4 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:02.830861 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-54086469-8dd9-4847-9dd6-8e51c9b4a7d4 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:02.832396 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-54086469-8dd9-4847-9dd6-8e51c9b4a7d4 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:02.832737 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-54086469-8dd9-4847-9dd6-8e51c9b4a7d4 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:02.948098 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-013bfc44-8d9f-4dba-b6fc-c8b9e4d5efcc tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db87258db1424ce7a8399fdd05efe3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89d1b21ad8471a8a9a82adac2594c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:37:02.959801 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-013bfc44-8d9f-4dba-b6fc-c8b9e4d5efcc tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] 10.222.0.45 "GET /compute/v2.1/servers/06ae865a-6ba5-4198-be6d-e6056e645411" status: 200 len: 1522 microversion: 2.1 time: 0.350005 Jan 21 09:37:02.962123 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 107/231] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:37:02 2022] GET /compute/v2.1/servers/06ae865a-6ba5-4198-be6d-e6056e645411 => generated 1522 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:37:03.625021 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-a94ee06d-df81-4cad-86c2-b4d142294e4f tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:37:03.625720 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-a94ee06d-df81-4cad-86c2-b4d142294e4f tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] [instance: deb54068-874d-4b55-ab9c-777c53b1d707] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:37:03.637281 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-a94ee06d-df81-4cad-86c2-b4d142294e4f tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:03.637730 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-a94ee06d-df81-4cad-86c2-b4d142294e4f tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:03.638531 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-a94ee06d-df81-4cad-86c2-b4d142294e4f tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:03.638965 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-a94ee06d-df81-4cad-86c2-b4d142294e4f tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:03.838684 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-a94ee06d-df81-4cad-86c2-b4d142294e4f tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498146f6a6814129b393e7084057bfd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db07feb3a43432999da539b6b85fb2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:37:03.865661 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-a94ee06d-df81-4cad-86c2-b4d142294e4f tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] 10.222.0.45 "GET /compute/v2.1/servers/deb54068-874d-4b55-ab9c-777c53b1d707" status: 200 len: 1318 microversion: 2.1 time: 0.244087 Jan 21 09:37:03.868616 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 108/232] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:37:03 2022] GET /compute/v2.1/servers/deb54068-874d-4b55-ab9c-777c53b1d707 => generated 1318 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 09:37:03.877255 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-a0a92cc0-b25a-440f-b7f3-6be2c74a0ef8 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:37:03.877872 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-a0a92cc0-b25a-440f-b7f3-6be2c74a0ef8 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] [instance: bc1c3d0f-0474-4bad-b8a1-7c7d169b6ad0] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:37:03.885834 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-a0a92cc0-b25a-440f-b7f3-6be2c74a0ef8 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:03.886207 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-a0a92cc0-b25a-440f-b7f3-6be2c74a0ef8 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:03.890979 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-a0a92cc0-b25a-440f-b7f3-6be2c74a0ef8 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:03.890979 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-a0a92cc0-b25a-440f-b7f3-6be2c74a0ef8 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:04.081813 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-a0a92cc0-b25a-440f-b7f3-6be2c74a0ef8 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7b2c14d9444d65ab7a874e749671bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3390729231b409e9a83376b428c1a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:37:04.090681 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-a0a92cc0-b25a-440f-b7f3-6be2c74a0ef8 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] 10.222.0.45 "GET /compute/v2.1/servers/bc1c3d0f-0474-4bad-b8a1-7c7d169b6ad0" status: 200 len: 1318 microversion: 2.1 time: 0.219766 Jan 21 09:37:04.091602 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 109/233] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:37:03 2022] GET /compute/v2.1/servers/bc1c3d0f-0474-4bad-b8a1-7c7d169b6ad0 => generated 1318 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:37:04.096544 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [req-af754204-40a1-4837-a70f-4920822a0fb4 req-ac00a818-6ba0-4988-b657-e43c73447d90 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "deb54068-874d-4b55-ab9c-777c53b1d707", "name": "network-vif-plugged", "status": "completed", "tag": "14aab43b-4ab3-4c41-bc46-826e868d0936"}]} {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:37:04.098606 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 21 09:37:04.098606 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: warnings.warn(msg) Jan 21 09:37:04.107094 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [req-af754204-40a1-4837-a70f-4920822a0fb4 req-ac00a818-6ba0-4988-b657-e43c73447d90 service nova] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:04.107635 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [req-af754204-40a1-4837-a70f-4920822a0fb4 req-ac00a818-6ba0-4988-b657-e43c73447d90 service nova] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:04.122109 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.compute.server_external_events [req-af754204-40a1-4837-a70f-4920822a0fb4 req-ac00a818-6ba0-4988-b657-e43c73447d90 service nova] Creating event network-vif-plugged:14aab43b-4ab3-4c41-bc46-826e868d0936 for instance deb54068-874d-4b55-ab9c-777c53b1d707 on hv-cinder-80403 Jan 21 09:37:04.128072 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [req-af754204-40a1-4837-a70f-4920822a0fb4 req-ac00a818-6ba0-4988-b657-e43c73447d90 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035032 Jan 21 09:37:04.128667 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 110/234] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Jan 21 09:37:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 09:37:04.134337 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-eb833675-71d4-4740-973a-edc09001688f tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:37:04.135028 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-eb833675-71d4-4740-973a-edc09001688f tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] [instance: 06ae865a-6ba5-4198-be6d-e6056e645411] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:37:04.141234 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-eb833675-71d4-4740-973a-edc09001688f tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:04.141681 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-eb833675-71d4-4740-973a-edc09001688f tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:04.142524 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-eb833675-71d4-4740-973a-edc09001688f tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:04.142959 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-eb833675-71d4-4740-973a-edc09001688f tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:04.443926 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-eb833675-71d4-4740-973a-edc09001688f tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db87258db1424ce7a8399fdd05efe3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89d1b21ad8471a8a9a82adac2594c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:37:04.451163 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-eb833675-71d4-4740-973a-edc09001688f tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] 10.222.0.45 "GET /compute/v2.1/servers/06ae865a-6ba5-4198-be6d-e6056e645411" status: 200 len: 1522 microversion: 2.1 time: 0.321194 Jan 21 09:37:04.451775 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 111/235] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:37:04 2022] GET /compute/v2.1/servers/06ae865a-6ba5-4198-be6d-e6056e645411 => generated 1522 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:37:04.884715 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-e9a135a2-ed58-4770-bfc7-b952eede7b92 tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:37:04.885434 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-e9a135a2-ed58-4770-bfc7-b952eede7b92 tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] [instance: deb54068-874d-4b55-ab9c-777c53b1d707] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:37:04.891954 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-e9a135a2-ed58-4770-bfc7-b952eede7b92 tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:04.892324 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-e9a135a2-ed58-4770-bfc7-b952eede7b92 tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:04.893127 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-e9a135a2-ed58-4770-bfc7-b952eede7b92 tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:04.893582 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-e9a135a2-ed58-4770-bfc7-b952eede7b92 tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:05.059858 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-e9a135a2-ed58-4770-bfc7-b952eede7b92 tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498146f6a6814129b393e7084057bfd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db07feb3a43432999da539b6b85fb2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:37:05.067240 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-e9a135a2-ed58-4770-bfc7-b952eede7b92 tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] 10.222.0.45 "GET /compute/v2.1/servers/deb54068-874d-4b55-ab9c-777c53b1d707" status: 200 len: 1318 microversion: 2.1 time: 0.186293 Jan 21 09:37:05.072624 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 112/236] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:37:04 2022] GET /compute/v2.1/servers/deb54068-874d-4b55-ab9c-777c53b1d707 => generated 1318 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 09:37:05.110207 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-6dd84a6f-78a9-4aef-bc2e-852bdb451b72 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:37:05.112309 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-6dd84a6f-78a9-4aef-bc2e-852bdb451b72 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] [instance: bc1c3d0f-0474-4bad-b8a1-7c7d169b6ad0] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:37:05.117941 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-6dd84a6f-78a9-4aef-bc2e-852bdb451b72 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:05.118464 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-6dd84a6f-78a9-4aef-bc2e-852bdb451b72 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:05.119186 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-6dd84a6f-78a9-4aef-bc2e-852bdb451b72 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:05.119618 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-6dd84a6f-78a9-4aef-bc2e-852bdb451b72 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:05.272174 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-6dd84a6f-78a9-4aef-bc2e-852bdb451b72 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7b2c14d9444d65ab7a874e749671bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3390729231b409e9a83376b428c1a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:37:05.283855 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-6dd84a6f-78a9-4aef-bc2e-852bdb451b72 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] 10.222.0.45 "GET /compute/v2.1/servers/bc1c3d0f-0474-4bad-b8a1-7c7d169b6ad0" status: 200 len: 1318 microversion: 2.1 time: 0.177244 Jan 21 09:37:05.284885 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 113/237] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:37:05 2022] GET /compute/v2.1/servers/bc1c3d0f-0474-4bad-b8a1-7c7d169b6ad0 => generated 1318 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 09:37:05.469470 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-17413157-adc4-481d-9cf0-917689e7cb14 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:37:05.470090 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-17413157-adc4-481d-9cf0-917689e7cb14 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] [instance: 06ae865a-6ba5-4198-be6d-e6056e645411] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:37:05.492961 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-17413157-adc4-481d-9cf0-917689e7cb14 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:05.493580 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-17413157-adc4-481d-9cf0-917689e7cb14 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:05.494450 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-17413157-adc4-481d-9cf0-917689e7cb14 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:05.496382 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-17413157-adc4-481d-9cf0-917689e7cb14 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:05.558433 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-54086469-8dd9-4847-9dd6-8e51c9b4a7d4 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "POST /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901/action" status: 200 len: 26631 microversion: 2.20 time: 2.740754 Jan 21 09:37:05.632440 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 125/238] 10.222.0.45 () {62 vars in 1318 bytes} [Fri Jan 21 09:37:02 2022] POST /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901/action => generated 26631 bytes in 2748 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 21 09:37:05.801318 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-17413157-adc4-481d-9cf0-917689e7cb14 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db87258db1424ce7a8399fdd05efe3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89d1b21ad8471a8a9a82adac2594c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:37:05.810178 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-17413157-adc4-481d-9cf0-917689e7cb14 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] 10.222.0.45 "GET /compute/v2.1/servers/06ae865a-6ba5-4198-be6d-e6056e645411" status: 200 len: 1522 microversion: 2.1 time: 0.344630 Jan 21 09:37:05.811697 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 114/239] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:37:05 2022] GET /compute/v2.1/servers/06ae865a-6ba5-4198-be6d-e6056e645411 => generated 1522 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 09:37:05.916633 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-5169a158-b9fe-4c0d-a9dc-1e614ab980cd tempest-VolumesNegativeTest-363522902 tempest-VolumesNegativeTest-363522902-project] Action: 'create', calling method: .version_select at 0x7fb6c2e72b80>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-899166894", "metadata": {"Type": "work"}}} {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:37:05.918114 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-5169a158-b9fe-4c0d-a9dc-1e614ab980cd tempest-VolumesNegativeTest-363522902 tempest-VolumesNegativeTest-363522902-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=123387) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 21 09:37:05.919207 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-5169a158-b9fe-4c0d-a9dc-1e614ab980cd tempest-VolumesNegativeTest-363522902 tempest-VolumesNegativeTest-363522902-project] 10.222.0.45 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.336318 Jan 21 09:37:05.919840 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 126/240] 10.222.0.45 () {60 vars in 1155 bytes} [Fri Jan 21 09:37:05 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 338 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jan 21 09:37:05.929737 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-83c4d260-234c-4cda-b31a-227ea164b2cc tempest-VolumesNegativeTest-363522902 tempest-VolumesNegativeTest-363522902-project] Action: 'create', calling method: .version_select at 0x7fb6c37194c0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-506989227", "metadata": {"Type": "work"}}} {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:37:05.931438 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-83c4d260-234c-4cda-b31a-227ea164b2cc tempest-VolumesNegativeTest-363522902 tempest-VolumesNegativeTest-363522902-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=123386) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 21 09:37:05.935942 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-83c4d260-234c-4cda-b31a-227ea164b2cc tempest-VolumesNegativeTest-363522902 tempest-VolumesNegativeTest-363522902-project] 10.222.0.45 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.006959 Jan 21 09:37:05.935942 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 115/241] 10.222.0.45 () {60 vars in 1155 bytes} [Fri Jan 21 09:37:05 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 8 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jan 21 09:37:05.944096 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-e50f94f2-bfaa-450a-947c-8df30c7d180f tempest-VolumesNegativeTest-363522902 tempest-VolumesNegativeTest-363522902-project] Action: 'create', calling method: .version_select at 0x7fb6c2e72160>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1427210008", "metadata": {"Type": "work"}}} {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:37:05.945476 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-e50f94f2-bfaa-450a-947c-8df30c7d180f tempest-VolumesNegativeTest-363522902 tempest-VolumesNegativeTest-363522902-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=123387) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 21 09:37:05.946826 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-e50f94f2-bfaa-450a-947c-8df30c7d180f tempest-VolumesNegativeTest-363522902 tempest-VolumesNegativeTest-363522902-project] 10.222.0.45 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.006690 Jan 21 09:37:05.947269 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 127/242] 10.222.0.45 () {60 vars in 1155 bytes} [Fri Jan 21 09:37:05 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 8 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jan 21 09:37:05.957606 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-63d6617e-4cb4-4671-b79b-7d29f7dc3b7b tempest-VolumesNegativeTest-363522902 tempest-VolumesNegativeTest-363522902-project] Calling method '.version_select at 0x7fb6c36da0d0>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:37:05.995353 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.wsgi [None req-63d6617e-4cb4-4671-b79b-7d29f7dc3b7b tempest-VolumesNegativeTest-363522902 tempest-VolumesNegativeTest-363522902-project] HTTP exception thrown: Volume tempest-invalid-1164901139 could not be found. Jan 21 09:37:05.996088 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-63d6617e-4cb4-4671-b79b-7d29f7dc3b7b tempest-VolumesNegativeTest-363522902 tempest-VolumesNegativeTest-363522902-project] Returning 404 to user: Volume tempest-invalid-1164901139 could not be found. {{(pid=123386) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 21 09:37:05.997231 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-63d6617e-4cb4-4671-b79b-7d29f7dc3b7b tempest-VolumesNegativeTest-363522902 tempest-VolumesNegativeTest-363522902-project] 10.222.0.45 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1164901139" status: 404 len: 99 microversion: 2.1 time: 0.043701 Jan 21 09:37:06.002186 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 116/243] 10.222.0.45 () {58 vars in 1217 bytes} [Fri Jan 21 09:37:05 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1164901139 => generated 99 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jan 21 09:37:06.007108 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-c543d089-879c-4330-a9a9-b8b6c0e611cd tempest-VolumesNegativeTest-363522902 tempest-VolumesNegativeTest-363522902-project] 10.222.0.45 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003585 Jan 21 09:37:06.013753 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 128/244] 10.222.0.45 () {58 vars in 1139 bytes} [Fri Jan 21 09:37:06 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Jan 21 09:37:06.019813 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-193fa629-bcf3-4ea7-8ab7-53a83b63f061 tempest-VolumesNegativeTest-363522902 tempest-VolumesNegativeTest-363522902-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004417 Jan 21 09:37:06.020338 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 117/245] 10.222.0.45 () {58 vars in 1136 bytes} [Fri Jan 21 09:37:06 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Jan 21 09:37:06.031693 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-3febb52b-c19a-4f4f-b941-1a4cf46002b5 tempest-VolumesNegativeTest-363522902 tempest-VolumesNegativeTest-363522902-project] Calling method '.version_select at 0x7fb6c2e46160>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:37:06.071334 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.wsgi [None req-3febb52b-c19a-4f4f-b941-1a4cf46002b5 tempest-VolumesNegativeTest-363522902 tempest-VolumesNegativeTest-363522902-project] HTTP exception thrown: Volume 8b6ff14e-89e2-4076-af5b-ecc8c5f0a36b could not be found. Jan 21 09:37:06.071334 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-3febb52b-c19a-4f4f-b941-1a4cf46002b5 tempest-VolumesNegativeTest-363522902 tempest-VolumesNegativeTest-363522902-project] Returning 404 to user: Volume 8b6ff14e-89e2-4076-af5b-ecc8c5f0a36b could not be found. {{(pid=123387) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 21 09:37:06.071334 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-3febb52b-c19a-4f4f-b941-1a4cf46002b5 tempest-VolumesNegativeTest-363522902 tempest-VolumesNegativeTest-363522902-project] 10.222.0.45 "DELETE /compute/v2.1/os-volumes/8b6ff14e-89e2-4076-af5b-ecc8c5f0a36b" status: 404 len: 109 microversion: 2.1 time: 0.042420 Jan 21 09:37:06.071334 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 129/246] 10.222.0.45 () {58 vars in 1247 bytes} [Fri Jan 21 09:37:06 2022] DELETE /compute/v2.1/os-volumes/8b6ff14e-89e2-4076-af5b-ecc8c5f0a36b => generated 109 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 21 09:37:06.082720 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-2d5d34d9-844d-4fb3-a59d-9010948ccc3e tempest-VolumesNegativeTest-363522902 tempest-VolumesNegativeTest-363522902-project] Calling method '.version_select at 0x7fb6c3719f70>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:37:06.094750 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-297f9254-3e32-47cb-906e-1284fe82dafd tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:37:06.099760 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-297f9254-3e32-47cb-906e-1284fe82dafd tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] [instance: deb54068-874d-4b55-ab9c-777c53b1d707] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:37:06.104579 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-297f9254-3e32-47cb-906e-1284fe82dafd tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:06.105117 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-297f9254-3e32-47cb-906e-1284fe82dafd tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:06.106009 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-297f9254-3e32-47cb-906e-1284fe82dafd tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:06.106481 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-297f9254-3e32-47cb-906e-1284fe82dafd tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:06.117167 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.wsgi [None req-2d5d34d9-844d-4fb3-a59d-9010948ccc3e tempest-VolumesNegativeTest-363522902 tempest-VolumesNegativeTest-363522902-project] HTTP exception thrown: Volume ae7a8d8c-15d2-4503-b7ae-810adf7afee4 could not be found. Jan 21 09:37:06.117821 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-2d5d34d9-844d-4fb3-a59d-9010948ccc3e tempest-VolumesNegativeTest-363522902 tempest-VolumesNegativeTest-363522902-project] Returning 404 to user: Volume ae7a8d8c-15d2-4503-b7ae-810adf7afee4 could not be found. {{(pid=123386) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 21 09:37:06.118610 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-2d5d34d9-844d-4fb3-a59d-9010948ccc3e tempest-VolumesNegativeTest-363522902 tempest-VolumesNegativeTest-363522902-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/ae7a8d8c-15d2-4503-b7ae-810adf7afee4" status: 404 len: 109 microversion: 2.1 time: 0.043021 Jan 21 09:37:06.119322 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 118/247] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Jan 21 09:37:06 2022] GET /compute/v2.1/os-volumes/ae7a8d8c-15d2-4503-b7ae-810adf7afee4 => generated 109 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 21 09:37:06.303181 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-17f9d127-2986-4e79-892f-999a17a9d450 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:37:06.304210 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-17f9d127-2986-4e79-892f-999a17a9d450 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] [instance: bc1c3d0f-0474-4bad-b8a1-7c7d169b6ad0] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:37:06.311312 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-17f9d127-2986-4e79-892f-999a17a9d450 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:06.312197 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-17f9d127-2986-4e79-892f-999a17a9d450 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:06.313775 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-17f9d127-2986-4e79-892f-999a17a9d450 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:06.314570 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-17f9d127-2986-4e79-892f-999a17a9d450 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:06.380541 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-297f9254-3e32-47cb-906e-1284fe82dafd tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498146f6a6814129b393e7084057bfd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db07feb3a43432999da539b6b85fb2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:37:06.389273 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-297f9254-3e32-47cb-906e-1284fe82dafd tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] 10.222.0.45 "GET /compute/v2.1/servers/deb54068-874d-4b55-ab9c-777c53b1d707" status: 200 len: 1318 microversion: 2.1 time: 0.300759 Jan 21 09:37:06.419462 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 130/248] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:37:06 2022] GET /compute/v2.1/servers/deb54068-874d-4b55-ab9c-777c53b1d707 => generated 1318 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:37:06.557209 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-17f9d127-2986-4e79-892f-999a17a9d450 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7b2c14d9444d65ab7a874e749671bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3390729231b409e9a83376b428c1a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:37:06.568995 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-17f9d127-2986-4e79-892f-999a17a9d450 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] 10.222.0.45 "GET /compute/v2.1/servers/bc1c3d0f-0474-4bad-b8a1-7c7d169b6ad0" status: 200 len: 1318 microversion: 2.1 time: 0.271167 Jan 21 09:37:06.569862 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 119/249] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:37:06 2022] GET /compute/v2.1/servers/bc1c3d0f-0474-4bad-b8a1-7c7d169b6ad0 => generated 1318 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 09:37:06.584412 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-6a6f01e4-890e-4019-b878-ceff6a8e1462 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:37:06.584412 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-6a6f01e4-890e-4019-b878-ceff6a8e1462 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] [instance: 59ad64a5-af93-44ef-8031-fd2f2d18a901] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:37:06.592626 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-6a6f01e4-890e-4019-b878-ceff6a8e1462 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:06.593088 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-6a6f01e4-890e-4019-b878-ceff6a8e1462 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:06.593918 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-6a6f01e4-890e-4019-b878-ceff6a8e1462 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:06.594535 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-6a6f01e4-890e-4019-b878-ceff6a8e1462 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:06.657118 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [req-6c390c9e-0cdd-46c8-8556-0b3e7d75b824 req-6151991b-5ff7-4224-b92d-a2a6a8717fa3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bc1c3d0f-0474-4bad-b8a1-7c7d169b6ad0", "tag": "81cdcb77-b728-4dac-a9d7-2fe131466b38"}]} {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:37:06.658737 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 21 09:37:06.658737 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: warnings.warn(msg) Jan 21 09:37:06.666367 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [req-6c390c9e-0cdd-46c8-8556-0b3e7d75b824 req-6151991b-5ff7-4224-b92d-a2a6a8717fa3 service nova] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:06.666803 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [req-6c390c9e-0cdd-46c8-8556-0b3e7d75b824 req-6151991b-5ff7-4224-b92d-a2a6a8717fa3 service nova] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:06.678936 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.compute.server_external_events [req-6c390c9e-0cdd-46c8-8556-0b3e7d75b824 req-6151991b-5ff7-4224-b92d-a2a6a8717fa3 service nova] Creating event network-changed:81cdcb77-b728-4dac-a9d7-2fe131466b38 for instance bc1c3d0f-0474-4bad-b8a1-7c7d169b6ad0 on hv-cinder-80403 Jan 21 09:37:06.684361 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [req-6c390c9e-0cdd-46c8-8556-0b3e7d75b824 req-6151991b-5ff7-4224-b92d-a2a6a8717fa3 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030683 Jan 21 09:37:06.684956 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 120/250] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Jan 21 09:37:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 21 09:37:06.703863 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-6a6f01e4-890e-4019-b878-ceff6a8e1462 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "POST /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901/action" status: 200 len: 27145 microversion: 2.20 time: 0.135824 Jan 21 09:37:06.706296 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 131/251] 10.222.0.45 () {62 vars in 1318 bytes} [Fri Jan 21 09:37:06 2022] POST /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901/action => generated 27145 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 21 09:37:06.828253 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-a2b137a7-3828-413b-917a-c60b742e0764 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:37:06.828942 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-a2b137a7-3828-413b-917a-c60b742e0764 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] [instance: 06ae865a-6ba5-4198-be6d-e6056e645411] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:37:06.837254 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-a2b137a7-3828-413b-917a-c60b742e0764 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:06.838039 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-a2b137a7-3828-413b-917a-c60b742e0764 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:06.839064 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-a2b137a7-3828-413b-917a-c60b742e0764 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:06.839584 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-a2b137a7-3828-413b-917a-c60b742e0764 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:07.076624 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-a2b137a7-3828-413b-917a-c60b742e0764 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db87258db1424ce7a8399fdd05efe3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89d1b21ad8471a8a9a82adac2594c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:37:07.086095 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-a2b137a7-3828-413b-917a-c60b742e0764 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] 10.222.0.45 "GET /compute/v2.1/servers/06ae865a-6ba5-4198-be6d-e6056e645411" status: 200 len: 1522 microversion: 2.1 time: 0.261801 Jan 21 09:37:07.087708 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 121/252] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:37:06 2022] GET /compute/v2.1/servers/06ae865a-6ba5-4198-be6d-e6056e645411 => generated 1522 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:37:07.429522 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-331b3d83-cdec-4915-8307-7f9321dd64d9 tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:37:07.430508 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-331b3d83-cdec-4915-8307-7f9321dd64d9 tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] [instance: deb54068-874d-4b55-ab9c-777c53b1d707] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:37:07.452994 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-331b3d83-cdec-4915-8307-7f9321dd64d9 tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:07.453525 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-331b3d83-cdec-4915-8307-7f9321dd64d9 tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:07.458914 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-331b3d83-cdec-4915-8307-7f9321dd64d9 tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:07.458914 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-331b3d83-cdec-4915-8307-7f9321dd64d9 tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:07.588163 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-87acb892-08a3-4e73-8be1-837d01a6cba2 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:37:07.589044 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-87acb892-08a3-4e73-8be1-837d01a6cba2 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] [instance: bc1c3d0f-0474-4bad-b8a1-7c7d169b6ad0] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:37:07.595467 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-87acb892-08a3-4e73-8be1-837d01a6cba2 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:07.595915 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-87acb892-08a3-4e73-8be1-837d01a6cba2 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:07.596725 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-87acb892-08a3-4e73-8be1-837d01a6cba2 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:07.597184 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-87acb892-08a3-4e73-8be1-837d01a6cba2 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:08.116085 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-331b3d83-cdec-4915-8307-7f9321dd64d9 tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498146f6a6814129b393e7084057bfd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db07feb3a43432999da539b6b85fb2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:37:08.126967 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-331b3d83-cdec-4915-8307-7f9321dd64d9 tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] 10.222.0.45 "GET /compute/v2.1/servers/deb54068-874d-4b55-ab9c-777c53b1d707" status: 200 len: 1318 microversion: 2.1 time: 0.703520 Jan 21 09:37:08.128545 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 132/253] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:37:07 2022] GET /compute/v2.1/servers/deb54068-874d-4b55-ab9c-777c53b1d707 => generated 1318 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:37:08.135363 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-a547cf03-be8a-4b66-92e9-44b39101192f tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:37:08.136681 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-a547cf03-be8a-4b66-92e9-44b39101192f tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] [instance: 59ad64a5-af93-44ef-8031-fd2f2d18a901] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:37:08.144530 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-a547cf03-be8a-4b66-92e9-44b39101192f tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:08.145292 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-a547cf03-be8a-4b66-92e9-44b39101192f tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:08.147018 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-a547cf03-be8a-4b66-92e9-44b39101192f tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:08.148356 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-a547cf03-be8a-4b66-92e9-44b39101192f tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:08.205952 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-87acb892-08a3-4e73-8be1-837d01a6cba2 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7b2c14d9444d65ab7a874e749671bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3390729231b409e9a83376b428c1a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:37:08.216019 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-87acb892-08a3-4e73-8be1-837d01a6cba2 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] 10.222.0.45 "GET /compute/v2.1/servers/bc1c3d0f-0474-4bad-b8a1-7c7d169b6ad0" status: 200 len: 1318 microversion: 2.1 time: 0.631482 Jan 21 09:37:08.216706 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 122/254] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:37:07 2022] GET /compute/v2.1/servers/bc1c3d0f-0474-4bad-b8a1-7c7d169b6ad0 => generated 1318 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:37:08.222227 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-d046770b-320d-4179-a14b-ab9b5ae4daf5 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:37:08.223102 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-d046770b-320d-4179-a14b-ab9b5ae4daf5 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] [instance: 06ae865a-6ba5-4198-be6d-e6056e645411] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:37:08.231363 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-d046770b-320d-4179-a14b-ab9b5ae4daf5 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:08.231817 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-d046770b-320d-4179-a14b-ab9b5ae4daf5 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:08.232837 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-d046770b-320d-4179-a14b-ab9b5ae4daf5 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:08.233391 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-d046770b-320d-4179-a14b-ab9b5ae4daf5 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:08.247529 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-a547cf03-be8a-4b66-92e9-44b39101192f tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "POST /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901/action" status: 200 len: 27602 microversion: 2.20 time: 0.116807 Jan 21 09:37:08.248203 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 133/255] 10.222.0.45 () {62 vars in 1318 bytes} [Fri Jan 21 09:37:08 2022] POST /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901/action => generated 27602 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 21 09:37:08.382878 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-d046770b-320d-4179-a14b-ab9b5ae4daf5 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db87258db1424ce7a8399fdd05efe3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89d1b21ad8471a8a9a82adac2594c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:37:08.390988 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-d046770b-320d-4179-a14b-ab9b5ae4daf5 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] 10.222.0.45 "GET /compute/v2.1/servers/06ae865a-6ba5-4198-be6d-e6056e645411" status: 200 len: 1522 microversion: 2.1 time: 0.173074 Jan 21 09:37:08.391720 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 123/256] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:37:08 2022] GET /compute/v2.1/servers/06ae865a-6ba5-4198-be6d-e6056e645411 => generated 1522 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:37:09.148073 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-8921d24b-592d-4591-a8c3-a3cc5bedbdec tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:37:09.148073 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-8921d24b-592d-4591-a8c3-a3cc5bedbdec tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] [instance: deb54068-874d-4b55-ab9c-777c53b1d707] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:37:09.164592 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-8921d24b-592d-4591-a8c3-a3cc5bedbdec tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:09.165039 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-8921d24b-592d-4591-a8c3-a3cc5bedbdec tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:09.165878 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-8921d24b-592d-4591-a8c3-a3cc5bedbdec tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:09.166358 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-8921d24b-592d-4591-a8c3-a3cc5bedbdec tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:09.235753 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-1fe3ab25-dd06-45a8-896a-48ec265e7476 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:37:09.236522 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-1fe3ab25-dd06-45a8-896a-48ec265e7476 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] [instance: bc1c3d0f-0474-4bad-b8a1-7c7d169b6ad0] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:37:09.244445 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-1fe3ab25-dd06-45a8-896a-48ec265e7476 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:09.244994 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-1fe3ab25-dd06-45a8-896a-48ec265e7476 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:09.246138 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-1fe3ab25-dd06-45a8-896a-48ec265e7476 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:09.247253 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-1fe3ab25-dd06-45a8-896a-48ec265e7476 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:09.357895 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-8921d24b-592d-4591-a8c3-a3cc5bedbdec tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498146f6a6814129b393e7084057bfd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db07feb3a43432999da539b6b85fb2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:37:09.366299 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-8921d24b-592d-4591-a8c3-a3cc5bedbdec tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] 10.222.0.45 "GET /compute/v2.1/servers/deb54068-874d-4b55-ab9c-777c53b1d707" status: 200 len: 1506 microversion: 2.1 time: 0.225076 Jan 21 09:37:09.367524 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 134/257] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:37:09 2022] GET /compute/v2.1/servers/deb54068-874d-4b55-ab9c-777c53b1d707 => generated 1506 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 09:37:09.372197 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-20fab4db-bbf7-464e-9889-1e3fb10e51fc tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:37:09.373111 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-20fab4db-bbf7-464e-9889-1e3fb10e51fc tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] [instance: 59ad64a5-af93-44ef-8031-fd2f2d18a901] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:37:09.384727 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-20fab4db-bbf7-464e-9889-1e3fb10e51fc tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:09.385287 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-20fab4db-bbf7-464e-9889-1e3fb10e51fc tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:09.386159 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-20fab4db-bbf7-464e-9889-1e3fb10e51fc tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:09.386673 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-20fab4db-bbf7-464e-9889-1e3fb10e51fc tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:09.446481 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-1fe3ab25-dd06-45a8-896a-48ec265e7476 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7b2c14d9444d65ab7a874e749671bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3390729231b409e9a83376b428c1a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:37:09.454677 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-1fe3ab25-dd06-45a8-896a-48ec265e7476 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] 10.222.0.45 "GET /compute/v2.1/servers/bc1c3d0f-0474-4bad-b8a1-7c7d169b6ad0" status: 200 len: 1318 microversion: 2.1 time: 0.222747 Jan 21 09:37:09.455640 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 124/258] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:37:09 2022] GET /compute/v2.1/servers/bc1c3d0f-0474-4bad-b8a1-7c7d169b6ad0 => generated 1318 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 09:37:09.460479 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-d8bbc323-a025-4cb8-a0bb-68d858ba119d tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:37:09.461088 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-d8bbc323-a025-4cb8-a0bb-68d858ba119d tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] [instance: 06ae865a-6ba5-4198-be6d-e6056e645411] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:37:09.467918 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-d8bbc323-a025-4cb8-a0bb-68d858ba119d tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:09.469003 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-d8bbc323-a025-4cb8-a0bb-68d858ba119d tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:09.469224 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-d8bbc323-a025-4cb8-a0bb-68d858ba119d tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:09.469689 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-d8bbc323-a025-4cb8-a0bb-68d858ba119d tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:09.501695 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-20fab4db-bbf7-464e-9889-1e3fb10e51fc tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "POST /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901/action" status: 200 len: 27785 microversion: 2.20 time: 0.132871 Jan 21 09:37:09.502622 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 135/259] 10.222.0.45 () {62 vars in 1318 bytes} [Fri Jan 21 09:37:09 2022] POST /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901/action => generated 27785 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 21 09:37:09.639916 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-d8bbc323-a025-4cb8-a0bb-68d858ba119d tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db87258db1424ce7a8399fdd05efe3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89d1b21ad8471a8a9a82adac2594c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:37:09.652803 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-d8bbc323-a025-4cb8-a0bb-68d858ba119d tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] 10.222.0.45 "GET /compute/v2.1/servers/06ae865a-6ba5-4198-be6d-e6056e645411" status: 200 len: 1522 microversion: 2.1 time: 0.195290 Jan 21 09:37:09.663413 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 125/260] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:37:09 2022] GET /compute/v2.1/servers/06ae865a-6ba5-4198-be6d-e6056e645411 => generated 1522 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:37:10.472744 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-ed438e73-4d8f-4816-ace2-0e7b11390514 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:37:10.474264 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-ed438e73-4d8f-4816-ace2-0e7b11390514 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] [instance: bc1c3d0f-0474-4bad-b8a1-7c7d169b6ad0] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:37:10.481805 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-ed438e73-4d8f-4816-ace2-0e7b11390514 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:10.482929 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-ed438e73-4d8f-4816-ace2-0e7b11390514 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:10.484195 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-ed438e73-4d8f-4816-ace2-0e7b11390514 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:10.484847 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-ed438e73-4d8f-4816-ace2-0e7b11390514 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:10.515777 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-0380c300-74e2-484d-a645-e5429f90135e tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:37:10.517606 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-0380c300-74e2-484d-a645-e5429f90135e tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] [instance: 59ad64a5-af93-44ef-8031-fd2f2d18a901] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:37:10.528181 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-0380c300-74e2-484d-a645-e5429f90135e tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:10.533402 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-0380c300-74e2-484d-a645-e5429f90135e tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:10.535784 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-0380c300-74e2-484d-a645-e5429f90135e tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:10.535784 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-0380c300-74e2-484d-a645-e5429f90135e tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:10.634958 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-ed438e73-4d8f-4816-ace2-0e7b11390514 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7b2c14d9444d65ab7a874e749671bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3390729231b409e9a83376b428c1a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:37:10.646305 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-ed438e73-4d8f-4816-ace2-0e7b11390514 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] 10.222.0.45 "GET /compute/v2.1/servers/bc1c3d0f-0474-4bad-b8a1-7c7d169b6ad0" status: 200 len: 1318 microversion: 2.1 time: 0.176705 Jan 21 09:37:10.648672 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 136/261] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:37:10 2022] GET /compute/v2.1/servers/bc1c3d0f-0474-4bad-b8a1-7c7d169b6ad0 => generated 1318 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:37:10.657272 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-0380c300-74e2-484d-a645-e5429f90135e tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "POST /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901/action" status: 200 len: 27973 microversion: 2.20 time: 0.142753 Jan 21 09:37:10.658321 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 126/262] 10.222.0.45 () {62 vars in 1318 bytes} [Fri Jan 21 09:37:10 2022] POST /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901/action => generated 27973 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 21 09:37:10.673651 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-8fe0bad1-6416-4e32-bef1-d81bba698c46 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:37:10.673651 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-8fe0bad1-6416-4e32-bef1-d81bba698c46 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] [instance: 06ae865a-6ba5-4198-be6d-e6056e645411] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:37:10.679463 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-8fe0bad1-6416-4e32-bef1-d81bba698c46 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:10.679949 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-8fe0bad1-6416-4e32-bef1-d81bba698c46 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:10.680712 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-8fe0bad1-6416-4e32-bef1-d81bba698c46 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:10.681337 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-8fe0bad1-6416-4e32-bef1-d81bba698c46 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:10.847908 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-8fe0bad1-6416-4e32-bef1-d81bba698c46 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db87258db1424ce7a8399fdd05efe3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89d1b21ad8471a8a9a82adac2594c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:37:10.856676 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-8fe0bad1-6416-4e32-bef1-d81bba698c46 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] 10.222.0.45 "GET /compute/v2.1/servers/06ae865a-6ba5-4198-be6d-e6056e645411" status: 200 len: 1522 microversion: 2.1 time: 0.190357 Jan 21 09:37:10.857391 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 137/263] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:37:10 2022] GET /compute/v2.1/servers/06ae865a-6ba5-4198-be6d-e6056e645411 => generated 1522 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:37:11.670733 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-b01c9d34-9e9e-405b-8093-c6f08cdbdf3f tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:37:11.674338 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-b01c9d34-9e9e-405b-8093-c6f08cdbdf3f tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] [instance: 59ad64a5-af93-44ef-8031-fd2f2d18a901] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:37:11.676440 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-9552bb33-976a-43a0-acc5-3e7766c22110 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:37:11.684585 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-9552bb33-976a-43a0-acc5-3e7766c22110 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] [instance: bc1c3d0f-0474-4bad-b8a1-7c7d169b6ad0] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:37:11.694470 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-b01c9d34-9e9e-405b-8093-c6f08cdbdf3f tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:11.698235 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-b01c9d34-9e9e-405b-8093-c6f08cdbdf3f tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:11.699884 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-b01c9d34-9e9e-405b-8093-c6f08cdbdf3f tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:11.701604 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-b01c9d34-9e9e-405b-8093-c6f08cdbdf3f tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:11.702054 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-9552bb33-976a-43a0-acc5-3e7766c22110 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:11.702668 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-9552bb33-976a-43a0-acc5-3e7766c22110 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:11.705028 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-9552bb33-976a-43a0-acc5-3e7766c22110 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:11.715693 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-9552bb33-976a-43a0-acc5-3e7766c22110 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:11.846367 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-b01c9d34-9e9e-405b-8093-c6f08cdbdf3f tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "POST /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901/action" status: 200 len: 28206 microversion: 2.20 time: 0.176153 Jan 21 09:37:11.846367 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 138/264] 10.222.0.45 () {62 vars in 1318 bytes} [Fri Jan 21 09:37:11 2022] POST /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901/action => generated 28206 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 21 09:37:11.877976 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-5737d082-31e8-4215-8f42-3a6d02390fed tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:37:11.879036 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-5737d082-31e8-4215-8f42-3a6d02390fed tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] [instance: 06ae865a-6ba5-4198-be6d-e6056e645411] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:37:11.889187 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-5737d082-31e8-4215-8f42-3a6d02390fed tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:11.889994 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-5737d082-31e8-4215-8f42-3a6d02390fed tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:11.890941 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-5737d082-31e8-4215-8f42-3a6d02390fed tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:11.891965 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-5737d082-31e8-4215-8f42-3a6d02390fed tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:12.019575 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-9552bb33-976a-43a0-acc5-3e7766c22110 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7b2c14d9444d65ab7a874e749671bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3390729231b409e9a83376b428c1a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:37:12.033994 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-9552bb33-976a-43a0-acc5-3e7766c22110 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] 10.222.0.45 "GET /compute/v2.1/servers/bc1c3d0f-0474-4bad-b8a1-7c7d169b6ad0" status: 200 len: 1318 microversion: 2.1 time: 0.373558 Jan 21 09:37:12.034906 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 127/265] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:37:11 2022] GET /compute/v2.1/servers/bc1c3d0f-0474-4bad-b8a1-7c7d169b6ad0 => generated 1318 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:37:12.131242 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-5737d082-31e8-4215-8f42-3a6d02390fed tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db87258db1424ce7a8399fdd05efe3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89d1b21ad8471a8a9a82adac2594c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:37:12.144410 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-5737d082-31e8-4215-8f42-3a6d02390fed tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] 10.222.0.45 "GET /compute/v2.1/servers/06ae865a-6ba5-4198-be6d-e6056e645411" status: 200 len: 1522 microversion: 2.1 time: 0.272689 Jan 21 09:37:12.146040 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 139/266] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:37:11 2022] GET /compute/v2.1/servers/06ae865a-6ba5-4198-be6d-e6056e645411 => generated 1522 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 09:37:12.861707 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-1eb95334-1004-416a-9ccc-69d105a5c6ed tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:37:12.863500 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-1eb95334-1004-416a-9ccc-69d105a5c6ed tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] [instance: 59ad64a5-af93-44ef-8031-fd2f2d18a901] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:37:12.872179 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-1eb95334-1004-416a-9ccc-69d105a5c6ed tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:12.873056 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-1eb95334-1004-416a-9ccc-69d105a5c6ed tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:12.873454 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-1eb95334-1004-416a-9ccc-69d105a5c6ed tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:12.873887 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-1eb95334-1004-416a-9ccc-69d105a5c6ed tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:13.060520 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-d98363af-da5f-4f4b-ada5-447ce392186e tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:37:13.061126 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-d98363af-da5f-4f4b-ada5-447ce392186e tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] [instance: bc1c3d0f-0474-4bad-b8a1-7c7d169b6ad0] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:37:13.067974 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-d98363af-da5f-4f4b-ada5-447ce392186e tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:13.068422 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-d98363af-da5f-4f4b-ada5-447ce392186e tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:13.069240 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-d98363af-da5f-4f4b-ada5-447ce392186e tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:13.069740 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-d98363af-da5f-4f4b-ada5-447ce392186e tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:13.247922 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-d98363af-da5f-4f4b-ada5-447ce392186e tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7b2c14d9444d65ab7a874e749671bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3390729231b409e9a83376b428c1a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:37:13.256441 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-d98363af-da5f-4f4b-ada5-447ce392186e tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] 10.222.0.45 "GET /compute/v2.1/servers/bc1c3d0f-0474-4bad-b8a1-7c7d169b6ad0" status: 200 len: 1318 microversion: 2.1 time: 0.199485 Jan 21 09:37:13.257014 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 140/267] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:37:13 2022] GET /compute/v2.1/servers/bc1c3d0f-0474-4bad-b8a1-7c7d169b6ad0 => generated 1318 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 09:37:13.262118 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-b6c6737c-a8f7-4e94-9e7b-0c21e98dd854 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:37:13.262950 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-b6c6737c-a8f7-4e94-9e7b-0c21e98dd854 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] [instance: 06ae865a-6ba5-4198-be6d-e6056e645411] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:37:13.272020 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-b6c6737c-a8f7-4e94-9e7b-0c21e98dd854 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:13.272467 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-b6c6737c-a8f7-4e94-9e7b-0c21e98dd854 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:13.273327 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-b6c6737c-a8f7-4e94-9e7b-0c21e98dd854 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:13.273761 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-b6c6737c-a8f7-4e94-9e7b-0c21e98dd854 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:13.425768 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-b6c6737c-a8f7-4e94-9e7b-0c21e98dd854 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db87258db1424ce7a8399fdd05efe3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89d1b21ad8471a8a9a82adac2594c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:37:13.434061 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-b6c6737c-a8f7-4e94-9e7b-0c21e98dd854 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] 10.222.0.45 "GET /compute/v2.1/servers/06ae865a-6ba5-4198-be6d-e6056e645411" status: 200 len: 1522 microversion: 2.1 time: 0.176005 Jan 21 09:37:13.436609 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 141/268] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:37:13 2022] GET /compute/v2.1/servers/06ae865a-6ba5-4198-be6d-e6056e645411 => generated 1522 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:37:14.274027 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-447636ef-0bbd-4777-af42-55e6a32d881d tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:37:14.274704 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-447636ef-0bbd-4777-af42-55e6a32d881d tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] [instance: bc1c3d0f-0474-4bad-b8a1-7c7d169b6ad0] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:37:14.280822 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-447636ef-0bbd-4777-af42-55e6a32d881d tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:14.281329 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-447636ef-0bbd-4777-af42-55e6a32d881d tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:14.282117 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-447636ef-0bbd-4777-af42-55e6a32d881d tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:14.282557 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-447636ef-0bbd-4777-af42-55e6a32d881d tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:14.427547 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-447636ef-0bbd-4777-af42-55e6a32d881d tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7b2c14d9444d65ab7a874e749671bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3390729231b409e9a83376b428c1a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:37:14.436789 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-447636ef-0bbd-4777-af42-55e6a32d881d tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] 10.222.0.45 "GET /compute/v2.1/servers/bc1c3d0f-0474-4bad-b8a1-7c7d169b6ad0" status: 200 len: 1318 microversion: 2.1 time: 0.166996 Jan 21 09:37:14.437884 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 142/269] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:37:14 2022] GET /compute/v2.1/servers/bc1c3d0f-0474-4bad-b8a1-7c7d169b6ad0 => generated 1318 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 09:37:14.452036 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-7c2dc123-d43d-45a0-a1c2-5f711f785422 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:37:14.452774 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-7c2dc123-d43d-45a0-a1c2-5f711f785422 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] [instance: 06ae865a-6ba5-4198-be6d-e6056e645411] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:37:14.459991 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-7c2dc123-d43d-45a0-a1c2-5f711f785422 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:14.460538 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-7c2dc123-d43d-45a0-a1c2-5f711f785422 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:14.461361 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-7c2dc123-d43d-45a0-a1c2-5f711f785422 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:14.461798 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-7c2dc123-d43d-45a0-a1c2-5f711f785422 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:14.603555 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-7c2dc123-d43d-45a0-a1c2-5f711f785422 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db87258db1424ce7a8399fdd05efe3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89d1b21ad8471a8a9a82adac2594c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:37:14.611522 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-7c2dc123-d43d-45a0-a1c2-5f711f785422 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] 10.222.0.45 "GET /compute/v2.1/servers/06ae865a-6ba5-4198-be6d-e6056e645411" status: 200 len: 1522 microversion: 2.1 time: 0.163435 Jan 21 09:37:14.612095 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 143/270] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:37:14 2022] GET /compute/v2.1/servers/06ae865a-6ba5-4198-be6d-e6056e645411 => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:37:14.893326 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-1eb95334-1004-416a-9ccc-69d105a5c6ed tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "POST /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901/action" status: 200 len: 28206 microversion: 2.20 time: 2.035151 Jan 21 09:37:14.894628 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 128/271] 10.222.0.45 () {62 vars in 1318 bytes} [Fri Jan 21 09:37:12 2022] POST /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901/action => generated 28206 bytes in 2038 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 21 09:37:15.454054 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-4944ac00-2f80-43ec-99cc-f1375e9005ac tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:37:15.454600 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-4944ac00-2f80-43ec-99cc-f1375e9005ac tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] [instance: bc1c3d0f-0474-4bad-b8a1-7c7d169b6ad0] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:37:15.462321 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-4944ac00-2f80-43ec-99cc-f1375e9005ac tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:15.462770 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-4944ac00-2f80-43ec-99cc-f1375e9005ac tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:15.463551 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-4944ac00-2f80-43ec-99cc-f1375e9005ac tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:15.464058 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-4944ac00-2f80-43ec-99cc-f1375e9005ac tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:15.617071 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-4944ac00-2f80-43ec-99cc-f1375e9005ac tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7b2c14d9444d65ab7a874e749671bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3390729231b409e9a83376b428c1a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:37:15.624570 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-4944ac00-2f80-43ec-99cc-f1375e9005ac tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] 10.222.0.45 "GET /compute/v2.1/servers/bc1c3d0f-0474-4bad-b8a1-7c7d169b6ad0" status: 200 len: 1318 microversion: 2.1 time: 0.174274 Jan 21 09:37:15.625163 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 144/272] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:37:15 2022] GET /compute/v2.1/servers/bc1c3d0f-0474-4bad-b8a1-7c7d169b6ad0 => generated 1318 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 09:37:15.630796 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-33faf299-e866-4584-b194-2720d00d5030 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:37:15.631693 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-33faf299-e866-4584-b194-2720d00d5030 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] [instance: 06ae865a-6ba5-4198-be6d-e6056e645411] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:37:15.638895 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-33faf299-e866-4584-b194-2720d00d5030 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:15.639345 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-33faf299-e866-4584-b194-2720d00d5030 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:15.640522 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-33faf299-e866-4584-b194-2720d00d5030 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:15.641220 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-33faf299-e866-4584-b194-2720d00d5030 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:15.788541 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-33faf299-e866-4584-b194-2720d00d5030 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db87258db1424ce7a8399fdd05efe3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89d1b21ad8471a8a9a82adac2594c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:37:15.798712 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-33faf299-e866-4584-b194-2720d00d5030 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] 10.222.0.45 "GET /compute/v2.1/servers/06ae865a-6ba5-4198-be6d-e6056e645411" status: 200 len: 1522 microversion: 2.1 time: 0.172719 Jan 21 09:37:15.799296 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 129/273] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:37:15 2022] GET /compute/v2.1/servers/06ae865a-6ba5-4198-be6d-e6056e645411 => generated 1522 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 09:37:15.906722 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-95ce3685-f854-4bb9-83fe-626749810dd6 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:37:15.907765 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-95ce3685-f854-4bb9-83fe-626749810dd6 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] [instance: 59ad64a5-af93-44ef-8031-fd2f2d18a901] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:37:15.919178 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-95ce3685-f854-4bb9-83fe-626749810dd6 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:15.919973 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-95ce3685-f854-4bb9-83fe-626749810dd6 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:15.920812 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-95ce3685-f854-4bb9-83fe-626749810dd6 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:15.921372 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-95ce3685-f854-4bb9-83fe-626749810dd6 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:15.994480 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-95ce3685-f854-4bb9-83fe-626749810dd6 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "POST /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901/action" status: 200 len: 28206 microversion: 2.20 time: 0.091299 Jan 21 09:37:15.995254 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 145/274] 10.222.0.45 () {62 vars in 1318 bytes} [Fri Jan 21 09:37:15 2022] POST /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901/action => generated 28206 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 21 09:37:16.648978 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-68b1a710-13dc-4722-b4cf-37a6afe3f381 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:37:16.650896 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-68b1a710-13dc-4722-b4cf-37a6afe3f381 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] [instance: bc1c3d0f-0474-4bad-b8a1-7c7d169b6ad0] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:37:16.666412 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-68b1a710-13dc-4722-b4cf-37a6afe3f381 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:16.667119 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-68b1a710-13dc-4722-b4cf-37a6afe3f381 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:16.668091 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-68b1a710-13dc-4722-b4cf-37a6afe3f381 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:16.668690 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-68b1a710-13dc-4722-b4cf-37a6afe3f381 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:16.816284 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-87283b25-c522-41df-a15e-26f7abfca6fa tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:37:16.817928 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-87283b25-c522-41df-a15e-26f7abfca6fa tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] [instance: 06ae865a-6ba5-4198-be6d-e6056e645411] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:37:16.824882 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-87283b25-c522-41df-a15e-26f7abfca6fa tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:16.825673 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-87283b25-c522-41df-a15e-26f7abfca6fa tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:16.827551 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-87283b25-c522-41df-a15e-26f7abfca6fa tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:16.828168 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-87283b25-c522-41df-a15e-26f7abfca6fa tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:16.829735 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-68b1a710-13dc-4722-b4cf-37a6afe3f381 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7b2c14d9444d65ab7a874e749671bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3390729231b409e9a83376b428c1a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:37:16.839281 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-68b1a710-13dc-4722-b4cf-37a6afe3f381 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] 10.222.0.45 "GET /compute/v2.1/servers/bc1c3d0f-0474-4bad-b8a1-7c7d169b6ad0" status: 200 len: 1318 microversion: 2.1 time: 0.199195 Jan 21 09:37:16.840044 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 130/275] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:37:16 2022] GET /compute/v2.1/servers/bc1c3d0f-0474-4bad-b8a1-7c7d169b6ad0 => generated 1318 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:37:17.002573 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-87283b25-c522-41df-a15e-26f7abfca6fa tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db87258db1424ce7a8399fdd05efe3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89d1b21ad8471a8a9a82adac2594c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:37:17.015216 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-6f1f7c21-8480-42ab-8c7c-9f594c3e43c4 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:37:17.016205 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-87283b25-c522-41df-a15e-26f7abfca6fa tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] 10.222.0.45 "GET /compute/v2.1/servers/06ae865a-6ba5-4198-be6d-e6056e645411" status: 200 len: 1522 microversion: 2.1 time: 0.203232 Jan 21 09:37:17.016525 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-6f1f7c21-8480-42ab-8c7c-9f594c3e43c4 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] [instance: 59ad64a5-af93-44ef-8031-fd2f2d18a901] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:37:17.017872 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 146/276] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:37:16 2022] GET /compute/v2.1/servers/06ae865a-6ba5-4198-be6d-e6056e645411 => generated 1522 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 09:37:17.048192 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-6f1f7c21-8480-42ab-8c7c-9f594c3e43c4 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:17.048707 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-6f1f7c21-8480-42ab-8c7c-9f594c3e43c4 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:17.059913 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-6f1f7c21-8480-42ab-8c7c-9f594c3e43c4 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:17.060509 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-6f1f7c21-8480-42ab-8c7c-9f594c3e43c4 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:17.205740 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-6f1f7c21-8480-42ab-8c7c-9f594c3e43c4 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "POST /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901/action" status: 200 len: 28497 microversion: 2.20 time: 0.200762 Jan 21 09:37:17.207121 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 131/277] 10.222.0.45 () {62 vars in 1318 bytes} [Fri Jan 21 09:37:17 2022] POST /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901/action => generated 28497 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 21 09:37:17.222414 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [req-09489896-b328-499a-8b4e-4b4506e96a68 req-65c34f25-9c9f-4f24-9452-3233c18039ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc1c3d0f-0474-4bad-b8a1-7c7d169b6ad0", "name": "network-vif-plugged", "status": "completed", "tag": "81cdcb77-b728-4dac-a9d7-2fe131466b38"}]} {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:37:17.225861 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 21 09:37:17.225861 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: warnings.warn(msg) Jan 21 09:37:17.236086 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [req-09489896-b328-499a-8b4e-4b4506e96a68 req-65c34f25-9c9f-4f24-9452-3233c18039ac service nova] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:17.236618 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [req-09489896-b328-499a-8b4e-4b4506e96a68 req-65c34f25-9c9f-4f24-9452-3233c18039ac service nova] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:17.250889 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.compute.server_external_events [req-09489896-b328-499a-8b4e-4b4506e96a68 req-65c34f25-9c9f-4f24-9452-3233c18039ac service nova] Creating event network-vif-plugged:81cdcb77-b728-4dac-a9d7-2fe131466b38 for instance bc1c3d0f-0474-4bad-b8a1-7c7d169b6ad0 on hv-cinder-80403 Jan 21 09:37:17.256724 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [req-09489896-b328-499a-8b4e-4b4506e96a68 req-65c34f25-9c9f-4f24-9452-3233c18039ac service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039299 Jan 21 09:37:17.257657 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 147/278] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Jan 21 09:37:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 09:37:17.858844 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-57baee15-f192-43b1-8c14-abf59c1b4a42 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:37:17.860201 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-57baee15-f192-43b1-8c14-abf59c1b4a42 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] [instance: bc1c3d0f-0474-4bad-b8a1-7c7d169b6ad0] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:37:17.869391 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-57baee15-f192-43b1-8c14-abf59c1b4a42 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:17.869837 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-57baee15-f192-43b1-8c14-abf59c1b4a42 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:17.870673 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-57baee15-f192-43b1-8c14-abf59c1b4a42 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:17.871298 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-57baee15-f192-43b1-8c14-abf59c1b4a42 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:18.019306 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-57baee15-f192-43b1-8c14-abf59c1b4a42 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7b2c14d9444d65ab7a874e749671bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3390729231b409e9a83376b428c1a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:37:18.026762 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-57baee15-f192-43b1-8c14-abf59c1b4a42 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] 10.222.0.45 "GET /compute/v2.1/servers/bc1c3d0f-0474-4bad-b8a1-7c7d169b6ad0" status: 200 len: 1318 microversion: 2.1 time: 0.172640 Jan 21 09:37:18.027392 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 132/279] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:37:17 2022] GET /compute/v2.1/servers/bc1c3d0f-0474-4bad-b8a1-7c7d169b6ad0 => generated 1318 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:37:18.043397 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-973f4c3d-8e47-499c-814a-3baff2d95e43 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:37:18.043940 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-973f4c3d-8e47-499c-814a-3baff2d95e43 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] [instance: 06ae865a-6ba5-4198-be6d-e6056e645411] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:37:18.053755 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-973f4c3d-8e47-499c-814a-3baff2d95e43 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:18.054213 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-973f4c3d-8e47-499c-814a-3baff2d95e43 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:18.055027 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-973f4c3d-8e47-499c-814a-3baff2d95e43 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:18.055512 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-973f4c3d-8e47-499c-814a-3baff2d95e43 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:18.198818 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-973f4c3d-8e47-499c-814a-3baff2d95e43 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db87258db1424ce7a8399fdd05efe3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89d1b21ad8471a8a9a82adac2594c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:37:18.207045 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-973f4c3d-8e47-499c-814a-3baff2d95e43 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] 10.222.0.45 "GET /compute/v2.1/servers/06ae865a-6ba5-4198-be6d-e6056e645411" status: 200 len: 1522 microversion: 2.1 time: 0.168897 Jan 21 09:37:18.208766 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 148/280] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:37:18 2022] GET /compute/v2.1/servers/06ae865a-6ba5-4198-be6d-e6056e645411 => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:37:18.223894 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-22ad8155-dafa-411f-b6aa-501785430e48 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:37:18.225329 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-22ad8155-dafa-411f-b6aa-501785430e48 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] [instance: 59ad64a5-af93-44ef-8031-fd2f2d18a901] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:37:18.232259 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-22ad8155-dafa-411f-b6aa-501785430e48 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:18.232687 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-22ad8155-dafa-411f-b6aa-501785430e48 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:18.233728 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-22ad8155-dafa-411f-b6aa-501785430e48 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:18.234349 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-22ad8155-dafa-411f-b6aa-501785430e48 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:18.313269 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-22ad8155-dafa-411f-b6aa-501785430e48 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "POST /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901/action" status: 200 len: 28497 microversion: 2.20 time: 0.093383 Jan 21 09:37:18.314027 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 133/281] 10.222.0.45 () {62 vars in 1318 bytes} [Fri Jan 21 09:37:18 2022] POST /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901/action => generated 28497 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 21 09:37:19.044758 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-e3bafe49-2f97-49db-bbe2-45b7456eceba tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:37:19.045536 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-e3bafe49-2f97-49db-bbe2-45b7456eceba tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] [instance: bc1c3d0f-0474-4bad-b8a1-7c7d169b6ad0] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:37:19.053263 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-e3bafe49-2f97-49db-bbe2-45b7456eceba tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:19.053729 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-e3bafe49-2f97-49db-bbe2-45b7456eceba tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:19.054596 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-e3bafe49-2f97-49db-bbe2-45b7456eceba tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:19.055148 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-e3bafe49-2f97-49db-bbe2-45b7456eceba tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:19.227754 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-9ea5501f-085e-495e-9ac2-df0df181c221 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:37:19.228479 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-9ea5501f-085e-495e-9ac2-df0df181c221 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] [instance: 06ae865a-6ba5-4198-be6d-e6056e645411] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:37:19.236070 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-9ea5501f-085e-495e-9ac2-df0df181c221 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:19.236896 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-9ea5501f-085e-495e-9ac2-df0df181c221 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:19.238125 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-9ea5501f-085e-495e-9ac2-df0df181c221 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:19.239002 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-9ea5501f-085e-495e-9ac2-df0df181c221 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:19.244023 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-e3bafe49-2f97-49db-bbe2-45b7456eceba tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7b2c14d9444d65ab7a874e749671bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3390729231b409e9a83376b428c1a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:37:19.252238 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-e3bafe49-2f97-49db-bbe2-45b7456eceba tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] 10.222.0.45 "GET /compute/v2.1/servers/bc1c3d0f-0474-4bad-b8a1-7c7d169b6ad0" status: 200 len: 1318 microversion: 2.1 time: 0.211802 Jan 21 09:37:19.262115 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 149/282] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:37:19 2022] GET /compute/v2.1/servers/bc1c3d0f-0474-4bad-b8a1-7c7d169b6ad0 => generated 1318 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 09:37:19.327584 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-86d472d8-65af-476e-ac53-31124a143d51 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:37:19.330096 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-86d472d8-65af-476e-ac53-31124a143d51 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] [instance: 59ad64a5-af93-44ef-8031-fd2f2d18a901] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:37:19.348109 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-86d472d8-65af-476e-ac53-31124a143d51 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:19.350351 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-86d472d8-65af-476e-ac53-31124a143d51 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:19.351139 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-86d472d8-65af-476e-ac53-31124a143d51 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:19.351580 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-86d472d8-65af-476e-ac53-31124a143d51 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:19.414004 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-9ea5501f-085e-495e-9ac2-df0df181c221 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db87258db1424ce7a8399fdd05efe3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89d1b21ad8471a8a9a82adac2594c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:37:19.423312 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-9ea5501f-085e-495e-9ac2-df0df181c221 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] 10.222.0.45 "GET /compute/v2.1/servers/06ae865a-6ba5-4198-be6d-e6056e645411" status: 200 len: 1522 microversion: 2.1 time: 0.201105 Jan 21 09:37:19.423936 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 134/283] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:37:19 2022] GET /compute/v2.1/servers/06ae865a-6ba5-4198-be6d-e6056e645411 => generated 1522 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 09:37:19.457509 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-86d472d8-65af-476e-ac53-31124a143d51 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "POST /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901/action" status: 200 len: 28665 microversion: 2.20 time: 0.134862 Jan 21 09:37:19.459879 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 150/284] 10.222.0.45 () {62 vars in 1318 bytes} [Fri Jan 21 09:37:19 2022] POST /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901/action => generated 28665 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 21 09:37:20.270766 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-74434b5f-5890-4ca9-91e0-bdf7116702b1 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:37:20.271645 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-74434b5f-5890-4ca9-91e0-bdf7116702b1 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] [instance: bc1c3d0f-0474-4bad-b8a1-7c7d169b6ad0] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:37:20.278607 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-74434b5f-5890-4ca9-91e0-bdf7116702b1 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:20.279127 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-74434b5f-5890-4ca9-91e0-bdf7116702b1 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:20.279930 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-74434b5f-5890-4ca9-91e0-bdf7116702b1 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:20.280372 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-74434b5f-5890-4ca9-91e0-bdf7116702b1 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:20.444338 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-2b8123c9-4245-4698-a0d2-a69c502e9b1e tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:37:20.445083 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-2b8123c9-4245-4698-a0d2-a69c502e9b1e tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] [instance: 06ae865a-6ba5-4198-be6d-e6056e645411] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:37:20.455568 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-2b8123c9-4245-4698-a0d2-a69c502e9b1e tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:20.469092 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-2b8123c9-4245-4698-a0d2-a69c502e9b1e tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:20.470013 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-2b8123c9-4245-4698-a0d2-a69c502e9b1e tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:20.470469 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-2b8123c9-4245-4698-a0d2-a69c502e9b1e tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:20.505357 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-74434b5f-5890-4ca9-91e0-bdf7116702b1 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7b2c14d9444d65ab7a874e749671bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3390729231b409e9a83376b428c1a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:37:20.514412 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-74434b5f-5890-4ca9-91e0-bdf7116702b1 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] 10.222.0.45 "GET /compute/v2.1/servers/bc1c3d0f-0474-4bad-b8a1-7c7d169b6ad0" status: 200 len: 1508 microversion: 2.1 time: 0.248907 Jan 21 09:37:20.527704 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 135/285] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:37:20 2022] GET /compute/v2.1/servers/bc1c3d0f-0474-4bad-b8a1-7c7d169b6ad0 => generated 1508 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:37:20.533262 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-723f436e-e858-4b66-adbc-b2b3e4cb6860 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:37:20.534714 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-723f436e-e858-4b66-adbc-b2b3e4cb6860 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] [instance: 59ad64a5-af93-44ef-8031-fd2f2d18a901] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:37:20.541879 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-723f436e-e858-4b66-adbc-b2b3e4cb6860 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:20.542721 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-723f436e-e858-4b66-adbc-b2b3e4cb6860 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:20.550739 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-723f436e-e858-4b66-adbc-b2b3e4cb6860 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:20.550739 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-723f436e-e858-4b66-adbc-b2b3e4cb6860 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:20.666259 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-723f436e-e858-4b66-adbc-b2b3e4cb6860 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "POST /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901/action" status: 200 len: 28665 microversion: 2.20 time: 0.137052 Jan 21 09:37:20.667649 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 136/286] 10.222.0.45 () {62 vars in 1318 bytes} [Fri Jan 21 09:37:20 2022] POST /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901/action => generated 28665 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 21 09:37:20.674575 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-5546c645-5f14-47d4-948f-b276fcb72a64 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "33687222-3e22-4b2c-a1eb-00913bdb131f"}} {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:37:20.676031 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-5546c645-5f14-47d4-948f-b276fcb72a64 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] [instance: bc1c3d0f-0474-4bad-b8a1-7c7d169b6ad0] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:37:20.686102 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-5546c645-5f14-47d4-948f-b276fcb72a64 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:20.690741 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-5546c645-5f14-47d4-948f-b276fcb72a64 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:20.693267 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-5546c645-5f14-47d4-948f-b276fcb72a64 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:20.695053 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-5546c645-5f14-47d4-948f-b276fcb72a64 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:20.793837 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-2b8123c9-4245-4698-a0d2-a69c502e9b1e tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db87258db1424ce7a8399fdd05efe3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89d1b21ad8471a8a9a82adac2594c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:37:20.803753 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-2b8123c9-4245-4698-a0d2-a69c502e9b1e tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] 10.222.0.45 "GET /compute/v2.1/servers/06ae865a-6ba5-4198-be6d-e6056e645411" status: 200 len: 1522 microversion: 2.1 time: 0.365506 Jan 21 09:37:20.806356 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 151/287] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:37:20 2022] GET /compute/v2.1/servers/06ae865a-6ba5-4198-be6d-e6056e645411 => generated 1522 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 09:37:20.827254 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.wsgi [None req-5546c645-5f14-47d4-948f-b276fcb72a64 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] HTTP exception thrown: Invalid volume: volume 33687222-3e22-4b2c-a1eb-00913bdb131f is already attached to instances: 370b78d2-d154-4c93-b8ef-3723bd26c3d4 Jan 21 09:37:20.827923 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-5546c645-5f14-47d4-948f-b276fcb72a64 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Returning 400 to user: Invalid volume: volume 33687222-3e22-4b2c-a1eb-00913bdb131f is already attached to instances: 370b78d2-d154-4c93-b8ef-3723bd26c3d4 {{(pid=123386) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 21 09:37:20.828874 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-5546c645-5f14-47d4-948f-b276fcb72a64 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] 10.222.0.45 "POST /compute/v2.1/servers/bc1c3d0f-0474-4bad-b8a1-7c7d169b6ad0/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.159738 Jan 21 09:37:20.829931 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 137/288] 10.222.0.45 () {60 vars in 1322 bytes} [Fri Jan 21 09:37:20 2022] POST /compute/v2.1/servers/bc1c3d0f-0474-4bad-b8a1-7c7d169b6ad0/os-volume_attachments => generated 174 bytes in 161 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jan 21 09:37:20.892087 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-c4183da5-4948-4c73-960a-579c9ffe0926 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:37:20.892696 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-c4183da5-4948-4c73-960a-579c9ffe0926 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] [instance: 370b78d2-d154-4c93-b8ef-3723bd26c3d4] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:37:20.899065 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-c4183da5-4948-4c73-960a-579c9ffe0926 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:20.899522 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-c4183da5-4948-4c73-960a-579c9ffe0926 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:20.900319 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-c4183da5-4948-4c73-960a-579c9ffe0926 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:20.900761 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-c4183da5-4948-4c73-960a-579c9ffe0926 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:21.035037 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.objects.instance [None req-c4183da5-4948-4c73-960a-579c9ffe0926 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lazy-loading 'services' on Instance uuid 370b78d2-d154-4c93-b8ef-3723bd26c3d4 {{(pid=123387) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 21 09:37:21.349268 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-c4183da5-4948-4c73-960a-579c9ffe0926 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] 10.222.0.45 "DELETE /compute/v2.1/servers/370b78d2-d154-4c93-b8ef-3723bd26c3d4/os-volume_attachments/33687222-3e22-4b2c-a1eb-00913bdb131f" status: 202 len: 0 microversion: 2.1 time: 0.460958 Jan 21 09:37:21.350250 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 152/289] 10.222.0.45 () {58 vars in 1415 bytes} [Fri Jan 21 09:37:20 2022] DELETE /compute/v2.1/servers/370b78d2-d154-4c93-b8ef-3723bd26c3d4/os-volume_attachments/33687222-3e22-4b2c-a1eb-00913bdb131f => generated 0 bytes in 463 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 21 09:37:21.358527 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-8eee2bed-7448-4023-8509-805dc0a822e2 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:37:21.359629 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-8eee2bed-7448-4023-8509-805dc0a822e2 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] [instance: 370b78d2-d154-4c93-b8ef-3723bd26c3d4] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:37:21.368584 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-8eee2bed-7448-4023-8509-805dc0a822e2 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:21.369040 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-8eee2bed-7448-4023-8509-805dc0a822e2 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:21.369873 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-8eee2bed-7448-4023-8509-805dc0a822e2 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:21.370511 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-8eee2bed-7448-4023-8509-805dc0a822e2 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:21.408125 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-8eee2bed-7448-4023-8509-805dc0a822e2 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] 10.222.0.45 "GET /compute/v2.1/servers/370b78d2-d154-4c93-b8ef-3723bd26c3d4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053337 Jan 21 09:37:21.408708 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 138/290] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Jan 21 09:37:21 2022] GET /compute/v2.1/servers/370b78d2-d154-4c93-b8ef-3723bd26c3d4/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 21 09:37:21.678736 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-1d8ce0a4-0d66-4a9b-83d0-6265dcd194ab tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:37:21.679784 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-1d8ce0a4-0d66-4a9b-83d0-6265dcd194ab tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] [instance: 59ad64a5-af93-44ef-8031-fd2f2d18a901] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:37:21.686303 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-1d8ce0a4-0d66-4a9b-83d0-6265dcd194ab tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:21.686751 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-1d8ce0a4-0d66-4a9b-83d0-6265dcd194ab tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:21.687558 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-1d8ce0a4-0d66-4a9b-83d0-6265dcd194ab tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:21.687993 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-1d8ce0a4-0d66-4a9b-83d0-6265dcd194ab tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:21.770675 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-1d8ce0a4-0d66-4a9b-83d0-6265dcd194ab tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "POST /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901/action" status: 200 len: 28665 microversion: 2.20 time: 0.095937 Jan 21 09:37:21.771589 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 153/291] 10.222.0.45 () {62 vars in 1318 bytes} [Fri Jan 21 09:37:21 2022] POST /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901/action => generated 28665 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 21 09:37:21.823151 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-8f37c220-d184-4fb1-aedf-d37e8bc1a4f2 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:37:21.824165 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-8f37c220-d184-4fb1-aedf-d37e8bc1a4f2 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] [instance: 06ae865a-6ba5-4198-be6d-e6056e645411] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:37:21.833818 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-8f37c220-d184-4fb1-aedf-d37e8bc1a4f2 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:21.834764 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-8f37c220-d184-4fb1-aedf-d37e8bc1a4f2 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:21.835902 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-8f37c220-d184-4fb1-aedf-d37e8bc1a4f2 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:21.836784 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-8f37c220-d184-4fb1-aedf-d37e8bc1a4f2 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:22.012912 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-8f37c220-d184-4fb1-aedf-d37e8bc1a4f2 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db87258db1424ce7a8399fdd05efe3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89d1b21ad8471a8a9a82adac2594c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:37:22.023740 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-8f37c220-d184-4fb1-aedf-d37e8bc1a4f2 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] 10.222.0.45 "GET /compute/v2.1/servers/06ae865a-6ba5-4198-be6d-e6056e645411" status: 200 len: 1502 microversion: 2.1 time: 0.205343 Jan 21 09:37:22.024335 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 139/292] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:37:21 2022] GET /compute/v2.1/servers/06ae865a-6ba5-4198-be6d-e6056e645411 => generated 1502 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:37:22.051143 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-dde79d04-2454-45e3-916f-a4e0244565cf tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:37:22.054416 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-dde79d04-2454-45e3-916f-a4e0244565cf tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] [instance: 4e67b25e-7e65-4975-bafa-fceafcd53647] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:37:22.067822 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-dde79d04-2454-45e3-916f-a4e0244565cf tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:22.068735 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-dde79d04-2454-45e3-916f-a4e0244565cf tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:22.069973 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-dde79d04-2454-45e3-916f-a4e0244565cf tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:22.070720 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-dde79d04-2454-45e3-916f-a4e0244565cf tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:22.261631 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-dde79d04-2454-45e3-916f-a4e0244565cf tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db87258db1424ce7a8399fdd05efe3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89d1b21ad8471a8a9a82adac2594c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:37:22.261843 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-dde79d04-2454-45e3-916f-a4e0244565cf tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] 10.222.0.45 "GET /compute/v2.1/servers/4e67b25e-7e65-4975-bafa-fceafcd53647" status: 200 len: 1514 microversion: 2.1 time: 0.218188 Jan 21 09:37:22.262510 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 154/293] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:37:22 2022] GET /compute/v2.1/servers/4e67b25e-7e65-4975-bafa-fceafcd53647 => generated 1514 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:37:22.420048 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-a5b52b8e-6fb5-4547-8886-d8f3bd95ad25 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:37:22.420912 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-a5b52b8e-6fb5-4547-8886-d8f3bd95ad25 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] [instance: 370b78d2-d154-4c93-b8ef-3723bd26c3d4] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:37:22.431943 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-a5b52b8e-6fb5-4547-8886-d8f3bd95ad25 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:22.433747 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-a5b52b8e-6fb5-4547-8886-d8f3bd95ad25 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:22.434160 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-a5b52b8e-6fb5-4547-8886-d8f3bd95ad25 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:22.434922 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-a5b52b8e-6fb5-4547-8886-d8f3bd95ad25 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:22.530313 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-a5b52b8e-6fb5-4547-8886-d8f3bd95ad25 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] 10.222.0.45 "GET /compute/v2.1/servers/370b78d2-d154-4c93-b8ef-3723bd26c3d4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.113326 Jan 21 09:37:22.532244 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 140/294] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Jan 21 09:37:22 2022] GET /compute/v2.1/servers/370b78d2-d154-4c93-b8ef-3723bd26c3d4/os-volume_attachments => generated 197 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 09:37:22.782991 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-2622a629-fcc7-46b1-8a9d-ed8c1f49c21a tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:37:22.785022 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-2622a629-fcc7-46b1-8a9d-ed8c1f49c21a tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] [instance: 59ad64a5-af93-44ef-8031-fd2f2d18a901] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:37:22.793680 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-2622a629-fcc7-46b1-8a9d-ed8c1f49c21a tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:22.794369 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-2622a629-fcc7-46b1-8a9d-ed8c1f49c21a tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:22.795330 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-2622a629-fcc7-46b1-8a9d-ed8c1f49c21a tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:22.796738 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-2622a629-fcc7-46b1-8a9d-ed8c1f49c21a tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:22.912027 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-2622a629-fcc7-46b1-8a9d-ed8c1f49c21a tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "POST /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901/action" status: 200 len: 28665 microversion: 2.20 time: 0.133132 Jan 21 09:37:22.917454 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 155/295] 10.222.0.45 () {62 vars in 1318 bytes} [Fri Jan 21 09:37:22 2022] POST /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901/action => generated 28665 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 21 09:37:23.544302 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-1490241b-30ac-4432-ab35-3e9806190532 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:37:23.545650 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-1490241b-30ac-4432-ab35-3e9806190532 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] [instance: 370b78d2-d154-4c93-b8ef-3723bd26c3d4] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:37:23.553345 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-1490241b-30ac-4432-ab35-3e9806190532 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:23.553702 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-1490241b-30ac-4432-ab35-3e9806190532 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:23.554504 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-1490241b-30ac-4432-ab35-3e9806190532 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:23.554939 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-1490241b-30ac-4432-ab35-3e9806190532 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:23.610207 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-1490241b-30ac-4432-ab35-3e9806190532 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] 10.222.0.45 "GET /compute/v2.1/servers/370b78d2-d154-4c93-b8ef-3723bd26c3d4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.069567 Jan 21 09:37:23.611181 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 141/296] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Jan 21 09:37:23 2022] GET /compute/v2.1/servers/370b78d2-d154-4c93-b8ef-3723bd26c3d4/os-volume_attachments => generated 25 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 21 09:37:23.925580 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-943c6f59-15e6-4b3d-adde-6ebadea09e69 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:37:23.927260 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-943c6f59-15e6-4b3d-adde-6ebadea09e69 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] [instance: 59ad64a5-af93-44ef-8031-fd2f2d18a901] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:37:23.934318 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-943c6f59-15e6-4b3d-adde-6ebadea09e69 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:23.934761 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-943c6f59-15e6-4b3d-adde-6ebadea09e69 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:23.935549 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-943c6f59-15e6-4b3d-adde-6ebadea09e69 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:23.935977 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-943c6f59-15e6-4b3d-adde-6ebadea09e69 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:24.043950 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-943c6f59-15e6-4b3d-adde-6ebadea09e69 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "POST /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901/action" status: 200 len: 28665 microversion: 2.20 time: 0.121649 Jan 21 09:37:24.045301 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 156/297] 10.222.0.45 () {62 vars in 1318 bytes} [Fri Jan 21 09:37:23 2022] POST /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901/action => generated 28665 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 21 09:37:24.079432 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-9a33780b-cbdb-4049-9545-f6f215b6bcad tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1425841509", "imageRef": "813e53ee-82e7-4a13-9f63-a8be7b1089f1", "flavorRef": "452", "networks": [{"uuid": "6d3bfab5-614b-42ce-87b9-03bdb3f3c1da"}]}} {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:37:24.138217 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.network.neutron [None req-9a33780b-cbdb-4049-9545-f6f215b6bcad tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] validate_networks() for [('6d3bfab5-614b-42ce-87b9-03bdb3f3c1da', None, None, None, None, None)] {{(pid=123386) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 21 09:37:24.353704 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-1cf96536-dacf-4702-aa6e-722fd9aeb154 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:37:24.354768 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-1cf96536-dacf-4702-aa6e-722fd9aeb154 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] [instance: 4e67b25e-7e65-4975-bafa-fceafcd53647] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:37:24.363146 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-1cf96536-dacf-4702-aa6e-722fd9aeb154 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:24.363600 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-1cf96536-dacf-4702-aa6e-722fd9aeb154 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:24.364980 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-1cf96536-dacf-4702-aa6e-722fd9aeb154 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:24.365481 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-1cf96536-dacf-4702-aa6e-722fd9aeb154 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:24.399897 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.objects.instance [None req-1cf96536-dacf-4702-aa6e-722fd9aeb154 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lazy-loading 'flavor' on Instance uuid 4e67b25e-7e65-4975-bafa-fceafcd53647 {{(pid=123387) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 21 09:37:24.719850 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.virt.hardware [None req-9a33780b-cbdb-4049-9545-f6f215b6bcad tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Flavor limits 0:0:0 {{(pid=123386) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 21 09:37:24.720263 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.virt.hardware [None req-9a33780b-cbdb-4049-9545-f6f215b6bcad tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Image limits 0:0:0 {{(pid=123386) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 21 09:37:24.721523 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.virt.hardware [None req-9a33780b-cbdb-4049-9545-f6f215b6bcad tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Flavor pref 0:0:0 {{(pid=123386) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 21 09:37:24.721946 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.virt.hardware [None req-9a33780b-cbdb-4049-9545-f6f215b6bcad tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Image pref 0:0:0 {{(pid=123386) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 21 09:37:24.722356 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.virt.hardware [None req-9a33780b-cbdb-4049-9545-f6f215b6bcad tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123386) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 21 09:37:24.733965 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-9a33780b-cbdb-4049-9545-f6f215b6bcad tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:24.734405 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-9a33780b-cbdb-4049-9545-f6f215b6bcad tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:24.735792 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-9a33780b-cbdb-4049-9545-f6f215b6bcad tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:24.735792 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-9a33780b-cbdb-4049-9545-f6f215b6bcad tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:24.756170 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.quota [None req-9a33780b-cbdb-4049-9545-f6f215b6bcad tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Getting quotas for project e3390729231b409e9a83376b428c1a7f. Resources: {'cores', 'instances', 'ram'} {{(pid=123386) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 21 09:37:24.761261 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.quota [None req-9a33780b-cbdb-4049-9545-f6f215b6bcad tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Getting quotas for user fc7b2c14d9444d65ab7a874e749671bb and project e3390729231b409e9a83376b428c1a7f. Resources: {'cores', 'instances', 'ram'} {{(pid=123386) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 21 09:37:24.780842 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-9a33780b-cbdb-4049-9545-f6f215b6bcad tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Going to run 1 instances... {{(pid=123386) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 21 09:37:24.789641 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-9a33780b-cbdb-4049-9545-f6f215b6bcad tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] [instance: ad91ae0f-410b-479b-82f5-c0e18d325a8b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='813e53ee-82e7-4a13-9f63-a8be7b1089f1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123386) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 21 09:37:24.790611 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-1cf96536-dacf-4702-aa6e-722fd9aeb154 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] 10.222.0.45 "POST /compute/v2.1/servers/4e67b25e-7e65-4975-bafa-fceafcd53647/action" status: 200 len: 32 microversion: 2.1 time: 0.442131 Jan 21 09:37:24.791497 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 157/298] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Jan 21 09:37:24 2022] POST /compute/v2.1/servers/4e67b25e-7e65-4975-bafa-fceafcd53647/action => generated 32 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jan 21 09:37:24.808259 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-01fd83c2-d475-4e1e-9ca8-c861801a975c tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:37:24.811808 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-01fd83c2-d475-4e1e-9ca8-c861801a975c tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] [instance: 4e67b25e-7e65-4975-bafa-fceafcd53647] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:37:24.825597 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-01fd83c2-d475-4e1e-9ca8-c861801a975c tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:24.826058 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-01fd83c2-d475-4e1e-9ca8-c861801a975c tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:24.828710 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-01fd83c2-d475-4e1e-9ca8-c861801a975c tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:24.829241 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-01fd83c2-d475-4e1e-9ca8-c861801a975c tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:24.969351 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-9a33780b-cbdb-4049-9545-f6f215b6bcad tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.893481 Jan 21 09:37:24.975294 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 142/299] 10.222.0.45 () {60 vars in 1146 bytes} [Fri Jan 21 09:37:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 900 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 21 09:37:24.996330 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-0baed54c-1317-413b-879d-f49c563a871e tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:37:25.002301 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-0baed54c-1317-413b-879d-f49c563a871e tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] [instance: ad91ae0f-410b-479b-82f5-c0e18d325a8b] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:37:25.107111 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-0baed54c-1317-413b-879d-f49c563a871e tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7b2c14d9444d65ab7a874e749671bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3390729231b409e9a83376b428c1a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:37:25.133025 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-0baed54c-1317-413b-879d-f49c563a871e tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] 10.222.0.45 "GET /compute/v2.1/servers/ad91ae0f-410b-479b-82f5-c0e18d325a8b" status: 200 len: 1218 microversion: 2.1 time: 0.139094 Jan 21 09:37:25.142886 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 143/300] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:37:24 2022] GET /compute/v2.1/servers/ad91ae0f-410b-479b-82f5-c0e18d325a8b => generated 1218 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:37:25.147166 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-e6451132-b34e-4c7c-8897-ad43365f659c tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:37:25.148318 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-e6451132-b34e-4c7c-8897-ad43365f659c tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] [instance: 59ad64a5-af93-44ef-8031-fd2f2d18a901] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:37:25.162374 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-e6451132-b34e-4c7c-8897-ad43365f659c tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:25.162761 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-e6451132-b34e-4c7c-8897-ad43365f659c tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:25.163746 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-e6451132-b34e-4c7c-8897-ad43365f659c tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:25.164469 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-e6451132-b34e-4c7c-8897-ad43365f659c tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:25.231574 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-01fd83c2-d475-4e1e-9ca8-c861801a975c tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db87258db1424ce7a8399fdd05efe3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89d1b21ad8471a8a9a82adac2594c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:37:25.252840 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-01fd83c2-d475-4e1e-9ca8-c861801a975c tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] 10.222.0.45 "GET /compute/v2.1/servers/4e67b25e-7e65-4975-bafa-fceafcd53647" status: 200 len: 1520 microversion: 2.1 time: 0.454986 Jan 21 09:37:25.255006 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 158/301] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:37:24 2022] GET /compute/v2.1/servers/4e67b25e-7e65-4975-bafa-fceafcd53647 => generated 1520 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:37:25.288051 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-e6451132-b34e-4c7c-8897-ad43365f659c tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "POST /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901/action" status: 200 len: 29016 microversion: 2.20 time: 0.152272 Jan 21 09:37:25.288718 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 144/302] 10.222.0.45 () {62 vars in 1318 bytes} [Fri Jan 21 09:37:25 2022] POST /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901/action => generated 29016 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 21 09:37:26.166070 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-3514ded1-1016-4a58-ac8b-d3cee8573d5b tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:37:26.166654 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-3514ded1-1016-4a58-ac8b-d3cee8573d5b tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] [instance: ad91ae0f-410b-479b-82f5-c0e18d325a8b] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:37:26.175707 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-3514ded1-1016-4a58-ac8b-d3cee8573d5b tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:26.176722 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-3514ded1-1016-4a58-ac8b-d3cee8573d5b tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:26.177785 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-3514ded1-1016-4a58-ac8b-d3cee8573d5b tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:26.180801 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-3514ded1-1016-4a58-ac8b-d3cee8573d5b tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:26.256428 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-3514ded1-1016-4a58-ac8b-d3cee8573d5b tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7b2c14d9444d65ab7a874e749671bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3390729231b409e9a83376b428c1a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:37:26.272862 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-6b856ae2-29f5-48c8-8ab6-9afc25a47d7f tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:37:26.273685 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-6b856ae2-29f5-48c8-8ab6-9afc25a47d7f tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] [instance: 4e67b25e-7e65-4975-bafa-fceafcd53647] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:37:26.278258 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-3514ded1-1016-4a58-ac8b-d3cee8573d5b tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] 10.222.0.45 "GET /compute/v2.1/servers/ad91ae0f-410b-479b-82f5-c0e18d325a8b" status: 200 len: 1222 microversion: 2.1 time: 0.119931 Jan 21 09:37:26.278924 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 159/303] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:37:26 2022] GET /compute/v2.1/servers/ad91ae0f-410b-479b-82f5-c0e18d325a8b => generated 1222 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:37:26.284977 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-6b856ae2-29f5-48c8-8ab6-9afc25a47d7f tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:26.285633 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-6b856ae2-29f5-48c8-8ab6-9afc25a47d7f tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:26.286446 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-6b856ae2-29f5-48c8-8ab6-9afc25a47d7f tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:26.287083 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-6b856ae2-29f5-48c8-8ab6-9afc25a47d7f tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:26.301781 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-fc51c7aa-89af-4f5e-bfc7-a7db68becd6e tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:37:26.302728 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-fc51c7aa-89af-4f5e-bfc7-a7db68becd6e tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] [instance: 59ad64a5-af93-44ef-8031-fd2f2d18a901] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:37:26.308803 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-fc51c7aa-89af-4f5e-bfc7-a7db68becd6e tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:26.309301 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-fc51c7aa-89af-4f5e-bfc7-a7db68becd6e tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:26.310099 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-fc51c7aa-89af-4f5e-bfc7-a7db68becd6e tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:26.310531 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-fc51c7aa-89af-4f5e-bfc7-a7db68becd6e tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:26.445161 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-fc51c7aa-89af-4f5e-bfc7-a7db68becd6e tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "POST /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901/action" status: 200 len: 30162 microversion: 2.20 time: 0.148697 Jan 21 09:37:26.449200 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 160/304] 10.222.0.45 () {62 vars in 1318 bytes} [Fri Jan 21 09:37:26 2022] POST /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901/action => generated 30162 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 21 09:37:26.477783 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-6b856ae2-29f5-48c8-8ab6-9afc25a47d7f tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db87258db1424ce7a8399fdd05efe3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89d1b21ad8471a8a9a82adac2594c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:37:26.488124 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-6b856ae2-29f5-48c8-8ab6-9afc25a47d7f tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] 10.222.0.45 "GET /compute/v2.1/servers/4e67b25e-7e65-4975-bafa-fceafcd53647" status: 200 len: 1520 microversion: 2.1 time: 0.220265 Jan 21 09:37:26.489874 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 145/305] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:37:26 2022] GET /compute/v2.1/servers/4e67b25e-7e65-4975-bafa-fceafcd53647 => generated 1520 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:37:27.296194 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-f61db2ff-ed6b-441e-a64f-c9e2b3a74566 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:37:27.296887 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-f61db2ff-ed6b-441e-a64f-c9e2b3a74566 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] [instance: ad91ae0f-410b-479b-82f5-c0e18d325a8b] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:37:27.304245 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-f61db2ff-ed6b-441e-a64f-c9e2b3a74566 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:27.304687 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-f61db2ff-ed6b-441e-a64f-c9e2b3a74566 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:27.305687 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-f61db2ff-ed6b-441e-a64f-c9e2b3a74566 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:27.306081 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-f61db2ff-ed6b-441e-a64f-c9e2b3a74566 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:27.371390 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-f61db2ff-ed6b-441e-a64f-c9e2b3a74566 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7b2c14d9444d65ab7a874e749671bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3390729231b409e9a83376b428c1a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:37:27.380479 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-f61db2ff-ed6b-441e-a64f-c9e2b3a74566 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] 10.222.0.45 "GET /compute/v2.1/servers/ad91ae0f-410b-479b-82f5-c0e18d325a8b" status: 200 len: 1270 microversion: 2.1 time: 0.087609 Jan 21 09:37:27.381260 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 161/306] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:37:27 2022] GET /compute/v2.1/servers/ad91ae0f-410b-479b-82f5-c0e18d325a8b => generated 1270 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:37:27.462925 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-dac9f168-5425-4ba0-905c-ef15149f83b6 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:37:27.463664 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-dac9f168-5425-4ba0-905c-ef15149f83b6 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] [instance: 59ad64a5-af93-44ef-8031-fd2f2d18a901] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:37:27.482081 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-dac9f168-5425-4ba0-905c-ef15149f83b6 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:27.482533 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-dac9f168-5425-4ba0-905c-ef15149f83b6 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:27.483366 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-dac9f168-5425-4ba0-905c-ef15149f83b6 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:27.483796 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-dac9f168-5425-4ba0-905c-ef15149f83b6 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:27.508527 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-78c86976-9684-48b2-9a27-b967022ec657 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:37:27.509526 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-78c86976-9684-48b2-9a27-b967022ec657 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] [instance: 4e67b25e-7e65-4975-bafa-fceafcd53647] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:37:27.521902 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-78c86976-9684-48b2-9a27-b967022ec657 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:27.521902 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-78c86976-9684-48b2-9a27-b967022ec657 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:27.521902 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-78c86976-9684-48b2-9a27-b967022ec657 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:27.521902 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-78c86976-9684-48b2-9a27-b967022ec657 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:27.603431 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-dac9f168-5425-4ba0-905c-ef15149f83b6 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "POST /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901/action" status: 200 len: 31418 microversion: 2.20 time: 0.147635 Jan 21 09:37:27.604975 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 146/307] 10.222.0.45 () {62 vars in 1318 bytes} [Fri Jan 21 09:37:27 2022] POST /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901/action => generated 31418 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 21 09:37:27.767124 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-78c86976-9684-48b2-9a27-b967022ec657 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db87258db1424ce7a8399fdd05efe3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89d1b21ad8471a8a9a82adac2594c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:37:27.776544 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-78c86976-9684-48b2-9a27-b967022ec657 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] 10.222.0.45 "GET /compute/v2.1/servers/4e67b25e-7e65-4975-bafa-fceafcd53647" status: 200 len: 1520 microversion: 2.1 time: 0.272448 Jan 21 09:37:27.777137 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 162/308] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:37:27 2022] GET /compute/v2.1/servers/4e67b25e-7e65-4975-bafa-fceafcd53647 => generated 1520 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 09:37:28.399276 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-78b0a6ba-b77f-4dd8-91e4-38cc1d6a8dcf tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:37:28.400086 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-78b0a6ba-b77f-4dd8-91e4-38cc1d6a8dcf tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] [instance: ad91ae0f-410b-479b-82f5-c0e18d325a8b] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:37:28.407858 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-78b0a6ba-b77f-4dd8-91e4-38cc1d6a8dcf tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:28.408388 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-78b0a6ba-b77f-4dd8-91e4-38cc1d6a8dcf tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:28.409442 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-78b0a6ba-b77f-4dd8-91e4-38cc1d6a8dcf tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:28.409873 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-78b0a6ba-b77f-4dd8-91e4-38cc1d6a8dcf tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:28.494995 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-78b0a6ba-b77f-4dd8-91e4-38cc1d6a8dcf tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7b2c14d9444d65ab7a874e749671bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3390729231b409e9a83376b428c1a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:37:28.502553 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-78b0a6ba-b77f-4dd8-91e4-38cc1d6a8dcf tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] 10.222.0.45 "GET /compute/v2.1/servers/ad91ae0f-410b-479b-82f5-c0e18d325a8b" status: 200 len: 1276 microversion: 2.1 time: 0.107727 Jan 21 09:37:28.503132 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 147/309] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:37:28 2022] GET /compute/v2.1/servers/ad91ae0f-410b-479b-82f5-c0e18d325a8b => generated 1276 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:37:28.617082 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-2759f195-fe90-4910-8abc-c3df55535d03 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:37:28.618039 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-2759f195-fe90-4910-8abc-c3df55535d03 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] [instance: 59ad64a5-af93-44ef-8031-fd2f2d18a901] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:37:28.625161 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-2759f195-fe90-4910-8abc-c3df55535d03 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:28.625642 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-2759f195-fe90-4910-8abc-c3df55535d03 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:28.626436 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-2759f195-fe90-4910-8abc-c3df55535d03 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:28.626863 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-2759f195-fe90-4910-8abc-c3df55535d03 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:28.738064 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-2759f195-fe90-4910-8abc-c3df55535d03 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "POST /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901/action" status: 200 len: 32402 microversion: 2.20 time: 0.125244 Jan 21 09:37:28.740009 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 163/310] 10.222.0.45 () {62 vars in 1318 bytes} [Fri Jan 21 09:37:28 2022] POST /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901/action => generated 32402 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 21 09:37:28.804150 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-ae52b0ba-f80e-4dd6-93d9-0682e4634d9d tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:37:28.805226 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-ae52b0ba-f80e-4dd6-93d9-0682e4634d9d tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] [instance: 4e67b25e-7e65-4975-bafa-fceafcd53647] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:37:28.820137 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-ae52b0ba-f80e-4dd6-93d9-0682e4634d9d tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:28.820783 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-ae52b0ba-f80e-4dd6-93d9-0682e4634d9d tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:28.823588 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-ae52b0ba-f80e-4dd6-93d9-0682e4634d9d tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:28.824112 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-ae52b0ba-f80e-4dd6-93d9-0682e4634d9d tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:29.159544 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-ae52b0ba-f80e-4dd6-93d9-0682e4634d9d tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db87258db1424ce7a8399fdd05efe3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89d1b21ad8471a8a9a82adac2594c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:37:29.167895 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-ae52b0ba-f80e-4dd6-93d9-0682e4634d9d tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] 10.222.0.45 "GET /compute/v2.1/servers/4e67b25e-7e65-4975-bafa-fceafcd53647" status: 200 len: 1520 microversion: 2.1 time: 0.371431 Jan 21 09:37:29.168469 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 148/311] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:37:28 2022] GET /compute/v2.1/servers/4e67b25e-7e65-4975-bafa-fceafcd53647 => generated 1520 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:37:29.521548 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-e7cc06c4-d4fc-46c4-992c-91e3db7a74a0 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:37:29.522259 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-e7cc06c4-d4fc-46c4-992c-91e3db7a74a0 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] [instance: ad91ae0f-410b-479b-82f5-c0e18d325a8b] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:37:29.531067 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-e7cc06c4-d4fc-46c4-992c-91e3db7a74a0 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:29.531544 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-e7cc06c4-d4fc-46c4-992c-91e3db7a74a0 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:29.532386 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-e7cc06c4-d4fc-46c4-992c-91e3db7a74a0 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:29.532740 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-e7cc06c4-d4fc-46c4-992c-91e3db7a74a0 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:29.755028 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-1937e7d1-453e-4af7-b86e-07e0e9d5eb97 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:37:29.756158 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-1937e7d1-453e-4af7-b86e-07e0e9d5eb97 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] [instance: 59ad64a5-af93-44ef-8031-fd2f2d18a901] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:37:29.784346 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-1937e7d1-453e-4af7-b86e-07e0e9d5eb97 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:29.784808 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-1937e7d1-453e-4af7-b86e-07e0e9d5eb97 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:29.785682 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-1937e7d1-453e-4af7-b86e-07e0e9d5eb97 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:29.786117 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-1937e7d1-453e-4af7-b86e-07e0e9d5eb97 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:29.903943 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-1937e7d1-453e-4af7-b86e-07e0e9d5eb97 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "POST /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901/action" status: 200 len: 33012 microversion: 2.20 time: 0.153084 Jan 21 09:37:29.905671 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 149/312] 10.222.0.45 () {62 vars in 1318 bytes} [Fri Jan 21 09:37:29 2022] POST /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901/action => generated 33012 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 21 09:37:30.008256 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-e7cc06c4-d4fc-46c4-992c-91e3db7a74a0 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7b2c14d9444d65ab7a874e749671bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3390729231b409e9a83376b428c1a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:37:30.017581 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-e7cc06c4-d4fc-46c4-992c-91e3db7a74a0 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] 10.222.0.45 "GET /compute/v2.1/servers/ad91ae0f-410b-479b-82f5-c0e18d325a8b" status: 200 len: 1318 microversion: 2.1 time: 0.500984 Jan 21 09:37:30.018443 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 164/313] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:37:29 2022] GET /compute/v2.1/servers/ad91ae0f-410b-479b-82f5-c0e18d325a8b => generated 1318 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:37:30.033557 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-4bf00568-adf3-4551-8b49-fb575efb96c0 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1657838863", "imageRef": "813e53ee-82e7-4a13-9f63-a8be7b1089f1", "flavorRef": "452", "networks": [{"uuid": "12c1a4df-23d6-4c4b-b623-e53eca6cd97e"}]}} {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:37:30.094635 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.network.neutron [None req-4bf00568-adf3-4551-8b49-fb575efb96c0 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] validate_networks() for [('12c1a4df-23d6-4c4b-b623-e53eca6cd97e', None, None, None, None, None)] {{(pid=123386) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 21 09:37:30.097685 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [req-7f842aea-0a15-43f8-9a49-4bf2978acc49 req-c79b36de-c1ec-47d9-a8b1-34925e066c93 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ad91ae0f-410b-479b-82f5-c0e18d325a8b", "tag": "57b1afe5-3070-43a1-9f90-584240e66081"}]} {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:37:30.100290 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 21 09:37:30.100290 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: warnings.warn(msg) Jan 21 09:37:30.109626 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [req-7f842aea-0a15-43f8-9a49-4bf2978acc49 req-c79b36de-c1ec-47d9-a8b1-34925e066c93 service nova] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:30.110161 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [req-7f842aea-0a15-43f8-9a49-4bf2978acc49 req-c79b36de-c1ec-47d9-a8b1-34925e066c93 service nova] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:30.122843 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.compute.server_external_events [req-7f842aea-0a15-43f8-9a49-4bf2978acc49 req-c79b36de-c1ec-47d9-a8b1-34925e066c93 service nova] Creating event network-changed:57b1afe5-3070-43a1-9f90-584240e66081 for instance ad91ae0f-410b-479b-82f5-c0e18d325a8b on hv-cinder-80403 Jan 21 09:37:30.127825 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [req-7f842aea-0a15-43f8-9a49-4bf2978acc49 req-c79b36de-c1ec-47d9-a8b1-34925e066c93 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037105 Jan 21 09:37:30.128648 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 165/314] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Jan 21 09:37:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 09:37:30.186174 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-a3223208-44dd-4989-97e6-9458e5c9b934 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:37:30.187070 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-a3223208-44dd-4989-97e6-9458e5c9b934 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] [instance: 4e67b25e-7e65-4975-bafa-fceafcd53647] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:37:30.194390 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-a3223208-44dd-4989-97e6-9458e5c9b934 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:30.194946 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-a3223208-44dd-4989-97e6-9458e5c9b934 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:30.195759 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-a3223208-44dd-4989-97e6-9458e5c9b934 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:30.196206 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-a3223208-44dd-4989-97e6-9458e5c9b934 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:30.574685 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-a3223208-44dd-4989-97e6-9458e5c9b934 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db87258db1424ce7a8399fdd05efe3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89d1b21ad8471a8a9a82adac2594c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:37:30.593058 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-a3223208-44dd-4989-97e6-9458e5c9b934 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] 10.222.0.45 "GET /compute/v2.1/servers/4e67b25e-7e65-4975-bafa-fceafcd53647" status: 200 len: 1520 microversion: 2.1 time: 0.410916 Jan 21 09:37:30.594007 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 166/315] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:37:30 2022] GET /compute/v2.1/servers/4e67b25e-7e65-4975-bafa-fceafcd53647 => generated 1520 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:37:30.778798 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.virt.hardware [None req-4bf00568-adf3-4551-8b49-fb575efb96c0 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Flavor limits 0:0:0 {{(pid=123386) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 21 09:37:30.779313 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.virt.hardware [None req-4bf00568-adf3-4551-8b49-fb575efb96c0 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Image limits 0:0:0 {{(pid=123386) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 21 09:37:30.779861 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.virt.hardware [None req-4bf00568-adf3-4551-8b49-fb575efb96c0 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Flavor pref 0:0:0 {{(pid=123386) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 21 09:37:30.780274 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.virt.hardware [None req-4bf00568-adf3-4551-8b49-fb575efb96c0 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Image pref 0:0:0 {{(pid=123386) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 21 09:37:30.780692 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.virt.hardware [None req-4bf00568-adf3-4551-8b49-fb575efb96c0 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123386) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 21 09:37:30.799156 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-4bf00568-adf3-4551-8b49-fb575efb96c0 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:30.799610 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-4bf00568-adf3-4551-8b49-fb575efb96c0 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:30.800433 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-4bf00568-adf3-4551-8b49-fb575efb96c0 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:30.800872 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-4bf00568-adf3-4551-8b49-fb575efb96c0 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:30.821467 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.quota [None req-4bf00568-adf3-4551-8b49-fb575efb96c0 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Getting quotas for project 6e1d230932114019a989885b46cb9283. Resources: {'cores', 'instances', 'ram'} {{(pid=123386) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 21 09:37:30.827728 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.quota [None req-4bf00568-adf3-4551-8b49-fb575efb96c0 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Getting quotas for user 7233857fe3a341b78e6449904cd935bf and project 6e1d230932114019a989885b46cb9283. Resources: {'cores', 'instances', 'ram'} {{(pid=123386) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 21 09:37:30.846742 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-4bf00568-adf3-4551-8b49-fb575efb96c0 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Going to run 1 instances... {{(pid=123386) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 21 09:37:30.849968 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-4bf00568-adf3-4551-8b49-fb575efb96c0 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] [instance: c2cf8bdb-ca1e-40cb-b09a-58e8e59a213f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='813e53ee-82e7-4a13-9f63-a8be7b1089f1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123386) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 21 09:37:30.917338 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-bda893b2-8031-4de7-a189-1cd2ac86d469 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:37:30.918410 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-bda893b2-8031-4de7-a189-1cd2ac86d469 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] [instance: 59ad64a5-af93-44ef-8031-fd2f2d18a901] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:37:30.924915 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-bda893b2-8031-4de7-a189-1cd2ac86d469 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:30.925665 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-bda893b2-8031-4de7-a189-1cd2ac86d469 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:30.927268 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-bda893b2-8031-4de7-a189-1cd2ac86d469 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:30.927701 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-bda893b2-8031-4de7-a189-1cd2ac86d469 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:30.982744 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-4bf00568-adf3-4551-8b49-fb575efb96c0 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.953245 Jan 21 09:37:30.983410 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 150/316] 10.222.0.45 () {60 vars in 1146 bytes} [Fri Jan 21 09:37:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 955 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 21 09:37:30.997857 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-58c075c6-1264-4aa8-a5e8-e2154991dc2e tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:37:30.998209 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-58c075c6-1264-4aa8-a5e8-e2154991dc2e tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] [instance: c2cf8bdb-ca1e-40cb-b09a-58e8e59a213f] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:37:31.041000 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-bda893b2-8031-4de7-a189-1cd2ac86d469 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "POST /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901/action" status: 200 len: 33341 microversion: 2.20 time: 0.127218 Jan 21 09:37:31.045391 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 167/317] 10.222.0.45 () {62 vars in 1318 bytes} [Fri Jan 21 09:37:30 2022] POST /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901/action => generated 33341 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 21 09:37:31.049238 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-91a87d9c-059e-4a93-9240-cbe036ccb76b tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:37:31.052240 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-91a87d9c-059e-4a93-9240-cbe036ccb76b tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] [instance: ad91ae0f-410b-479b-82f5-c0e18d325a8b] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:37:31.059472 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-91a87d9c-059e-4a93-9240-cbe036ccb76b tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:31.059916 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-91a87d9c-059e-4a93-9240-cbe036ccb76b tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:31.060714 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-91a87d9c-059e-4a93-9240-cbe036ccb76b tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:31.061451 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-91a87d9c-059e-4a93-9240-cbe036ccb76b tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:31.081427 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-58c075c6-1264-4aa8-a5e8-e2154991dc2e tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7233857fe3a341b78e6449904cd935bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1d230932114019a989885b46cb9283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:37:31.089259 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-58c075c6-1264-4aa8-a5e8-e2154991dc2e tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] 10.222.0.45 "GET /compute/v2.1/servers/c2cf8bdb-ca1e-40cb-b09a-58e8e59a213f" status: 200 len: 1214 microversion: 2.1 time: 0.097368 Jan 21 09:37:31.092573 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 151/318] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:37:30 2022] GET /compute/v2.1/servers/c2cf8bdb-ca1e-40cb-b09a-58e8e59a213f => generated 1214 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:37:31.352529 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-91a87d9c-059e-4a93-9240-cbe036ccb76b tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7b2c14d9444d65ab7a874e749671bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3390729231b409e9a83376b428c1a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:37:31.360252 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-91a87d9c-059e-4a93-9240-cbe036ccb76b tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] 10.222.0.45 "GET /compute/v2.1/servers/ad91ae0f-410b-479b-82f5-c0e18d325a8b" status: 200 len: 1318 microversion: 2.1 time: 0.316715 Jan 21 09:37:31.361069 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 168/319] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:37:31 2022] GET /compute/v2.1/servers/ad91ae0f-410b-479b-82f5-c0e18d325a8b => generated 1318 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:37:31.619420 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-5690fb0e-38b2-4292-b705-3cbe73a6db7e tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:37:31.620029 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-5690fb0e-38b2-4292-b705-3cbe73a6db7e tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] [instance: 4e67b25e-7e65-4975-bafa-fceafcd53647] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:37:31.626974 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-5690fb0e-38b2-4292-b705-3cbe73a6db7e tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:31.627422 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-5690fb0e-38b2-4292-b705-3cbe73a6db7e tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:31.628202 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-5690fb0e-38b2-4292-b705-3cbe73a6db7e tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:31.628637 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-5690fb0e-38b2-4292-b705-3cbe73a6db7e tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:31.800123 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-5690fb0e-38b2-4292-b705-3cbe73a6db7e tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db87258db1424ce7a8399fdd05efe3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89d1b21ad8471a8a9a82adac2594c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:37:31.815031 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-5690fb0e-38b2-4292-b705-3cbe73a6db7e tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] 10.222.0.45 "GET /compute/v2.1/servers/4e67b25e-7e65-4975-bafa-fceafcd53647" status: 200 len: 1520 microversion: 2.1 time: 0.199168 Jan 21 09:37:31.815605 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 152/320] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:37:31 2022] GET /compute/v2.1/servers/4e67b25e-7e65-4975-bafa-fceafcd53647 => generated 1520 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:37:31.932145 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-22eb3aca-5f87-407a-b3b0-398d62088782 tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "54dc78a6-469f-4ee8-85a0-a227bb8f2c7f", "device": "/dev/sdb"}} {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:37:31.933837 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-22eb3aca-5f87-407a-b3b0-398d62088782 tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] [instance: deb54068-874d-4b55-ab9c-777c53b1d707] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:37:31.941119 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-22eb3aca-5f87-407a-b3b0-398d62088782 tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:31.942149 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-22eb3aca-5f87-407a-b3b0-398d62088782 tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:31.943080 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-22eb3aca-5f87-407a-b3b0-398d62088782 tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:31.943719 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-22eb3aca-5f87-407a-b3b0-398d62088782 tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:32.054030 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-3b7b7029-f01f-45ac-a9ad-df4654a0d7d3 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:37:32.055057 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-3b7b7029-f01f-45ac-a9ad-df4654a0d7d3 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] [instance: 59ad64a5-af93-44ef-8031-fd2f2d18a901] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:37:32.061208 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-3b7b7029-f01f-45ac-a9ad-df4654a0d7d3 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:32.061659 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-3b7b7029-f01f-45ac-a9ad-df4654a0d7d3 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:32.062482 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-3b7b7029-f01f-45ac-a9ad-df4654a0d7d3 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:32.062926 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-3b7b7029-f01f-45ac-a9ad-df4654a0d7d3 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:32.195260 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-3b7b7029-f01f-45ac-a9ad-df4654a0d7d3 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "POST /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901/action" status: 200 len: 33764 microversion: 2.20 time: 0.145143 Jan 21 09:37:32.197697 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 153/321] 10.222.0.45 () {62 vars in 1318 bytes} [Fri Jan 21 09:37:32 2022] POST /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901/action => generated 33764 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 21 09:37:32.204972 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-38bc2f01-fa4f-4360-89eb-bdaa731e7a58 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:37:32.206026 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-38bc2f01-fa4f-4360-89eb-bdaa731e7a58 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] [instance: c2cf8bdb-ca1e-40cb-b09a-58e8e59a213f] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:37:32.215033 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-38bc2f01-fa4f-4360-89eb-bdaa731e7a58 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:32.215939 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-38bc2f01-fa4f-4360-89eb-bdaa731e7a58 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:32.216738 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-38bc2f01-fa4f-4360-89eb-bdaa731e7a58 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:32.217199 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-38bc2f01-fa4f-4360-89eb-bdaa731e7a58 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:32.284704 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-38bc2f01-fa4f-4360-89eb-bdaa731e7a58 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7233857fe3a341b78e6449904cd935bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1d230932114019a989885b46cb9283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:37:32.293202 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-38bc2f01-fa4f-4360-89eb-bdaa731e7a58 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] 10.222.0.45 "GET /compute/v2.1/servers/c2cf8bdb-ca1e-40cb-b09a-58e8e59a213f" status: 200 len: 1218 microversion: 2.1 time: 0.093792 Jan 21 09:37:32.293784 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 154/322] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:37:32 2022] GET /compute/v2.1/servers/c2cf8bdb-ca1e-40cb-b09a-58e8e59a213f => generated 1218 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:37:32.378543 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-42631171-e940-4d8e-9b87-cea0652ee013 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:37:32.379832 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-42631171-e940-4d8e-9b87-cea0652ee013 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] [instance: ad91ae0f-410b-479b-82f5-c0e18d325a8b] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:37:32.386499 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-42631171-e940-4d8e-9b87-cea0652ee013 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:32.387324 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-42631171-e940-4d8e-9b87-cea0652ee013 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:32.387863 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-42631171-e940-4d8e-9b87-cea0652ee013 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:32.388299 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-42631171-e940-4d8e-9b87-cea0652ee013 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:32.536353 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-42631171-e940-4d8e-9b87-cea0652ee013 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7b2c14d9444d65ab7a874e749671bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3390729231b409e9a83376b428c1a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:37:32.545396 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-42631171-e940-4d8e-9b87-cea0652ee013 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] 10.222.0.45 "GET /compute/v2.1/servers/ad91ae0f-410b-479b-82f5-c0e18d325a8b" status: 200 len: 1318 microversion: 2.1 time: 0.170531 Jan 21 09:37:32.545981 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 155/323] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:37:32 2022] GET /compute/v2.1/servers/ad91ae0f-410b-479b-82f5-c0e18d325a8b => generated 1318 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 09:37:32.834885 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-a763a685-3111-4714-9c57-c3f52c09f5b0 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:37:32.836212 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-a763a685-3111-4714-9c57-c3f52c09f5b0 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] [instance: 4e67b25e-7e65-4975-bafa-fceafcd53647] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:37:32.843732 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-a763a685-3111-4714-9c57-c3f52c09f5b0 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:32.844353 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-a763a685-3111-4714-9c57-c3f52c09f5b0 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:32.845286 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-a763a685-3111-4714-9c57-c3f52c09f5b0 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:32.845892 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-a763a685-3111-4714-9c57-c3f52c09f5b0 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:32.887490 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-22eb3aca-5f87-407a-b3b0-398d62088782 tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] 10.222.0.45 "POST /compute/v2.1/servers/deb54068-874d-4b55-ab9c-777c53b1d707/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.959489 Jan 21 09:37:32.892811 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 169/324] 10.222.0.45 () {60 vars in 1322 bytes} [Fri Jan 21 09:37:31 2022] POST /compute/v2.1/servers/deb54068-874d-4b55-ab9c-777c53b1d707/os-volume_attachments => generated 194 bytes in 966 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 09:37:33.054995 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-a763a685-3111-4714-9c57-c3f52c09f5b0 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db87258db1424ce7a8399fdd05efe3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89d1b21ad8471a8a9a82adac2594c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:37:33.065031 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-a763a685-3111-4714-9c57-c3f52c09f5b0 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] 10.222.0.45 "GET /compute/v2.1/servers/4e67b25e-7e65-4975-bafa-fceafcd53647" status: 200 len: 1520 microversion: 2.1 time: 0.235015 Jan 21 09:37:33.065759 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 156/325] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:37:32 2022] GET /compute/v2.1/servers/4e67b25e-7e65-4975-bafa-fceafcd53647 => generated 1520 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 09:37:33.208829 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-e318b244-5513-4f07-93e7-84f63ca05f18 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:37:33.210198 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-e318b244-5513-4f07-93e7-84f63ca05f18 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] [instance: 59ad64a5-af93-44ef-8031-fd2f2d18a901] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:37:33.217052 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-e318b244-5513-4f07-93e7-84f63ca05f18 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:33.217704 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-e318b244-5513-4f07-93e7-84f63ca05f18 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:33.218909 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-e318b244-5513-4f07-93e7-84f63ca05f18 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:33.219502 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-e318b244-5513-4f07-93e7-84f63ca05f18 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:33.311097 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-c7ba30f2-f356-43ac-adad-d757c68efd7d tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:37:33.311743 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-c7ba30f2-f356-43ac-adad-d757c68efd7d tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] [instance: c2cf8bdb-ca1e-40cb-b09a-58e8e59a213f] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:37:33.318257 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-c7ba30f2-f356-43ac-adad-d757c68efd7d tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:33.318847 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-c7ba30f2-f356-43ac-adad-d757c68efd7d tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:33.319694 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-c7ba30f2-f356-43ac-adad-d757c68efd7d tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:33.320132 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-c7ba30f2-f356-43ac-adad-d757c68efd7d tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:33.335739 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-e318b244-5513-4f07-93e7-84f63ca05f18 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "POST /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901/action" status: 200 len: 34499 microversion: 2.20 time: 0.131422 Jan 21 09:37:33.337238 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 170/326] 10.222.0.45 () {62 vars in 1318 bytes} [Fri Jan 21 09:37:33 2022] POST /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901/action => generated 34499 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 21 09:37:33.437802 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-c7ba30f2-f356-43ac-adad-d757c68efd7d tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7233857fe3a341b78e6449904cd935bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1d230932114019a989885b46cb9283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:37:33.451136 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-c7ba30f2-f356-43ac-adad-d757c68efd7d tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] 10.222.0.45 "GET /compute/v2.1/servers/c2cf8bdb-ca1e-40cb-b09a-58e8e59a213f" status: 200 len: 1266 microversion: 2.1 time: 0.143820 Jan 21 09:37:33.452342 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 157/327] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:37:33 2022] GET /compute/v2.1/servers/c2cf8bdb-ca1e-40cb-b09a-58e8e59a213f => generated 1266 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 09:37:33.563145 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-e67a4938-fa98-47f7-a564-8188e3b69107 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:37:33.563925 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-e67a4938-fa98-47f7-a564-8188e3b69107 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] [instance: ad91ae0f-410b-479b-82f5-c0e18d325a8b] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:37:33.571631 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-e67a4938-fa98-47f7-a564-8188e3b69107 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:33.576113 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-e67a4938-fa98-47f7-a564-8188e3b69107 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:33.576113 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-e67a4938-fa98-47f7-a564-8188e3b69107 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:33.576113 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-e67a4938-fa98-47f7-a564-8188e3b69107 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:33.770497 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-e67a4938-fa98-47f7-a564-8188e3b69107 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7b2c14d9444d65ab7a874e749671bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3390729231b409e9a83376b428c1a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:37:33.783196 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-e67a4938-fa98-47f7-a564-8188e3b69107 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] 10.222.0.45 "GET /compute/v2.1/servers/ad91ae0f-410b-479b-82f5-c0e18d325a8b" status: 200 len: 1318 microversion: 2.1 time: 0.223970 Jan 21 09:37:33.784600 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 171/328] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:37:33 2022] GET /compute/v2.1/servers/ad91ae0f-410b-479b-82f5-c0e18d325a8b => generated 1318 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:37:34.093070 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-8da1a5f4-bca8-447c-a156-1a25e77e15ef tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:37:34.093712 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-8da1a5f4-bca8-447c-a156-1a25e77e15ef tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] [instance: 4e67b25e-7e65-4975-bafa-fceafcd53647] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:37:34.109457 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-8da1a5f4-bca8-447c-a156-1a25e77e15ef tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:34.109914 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-8da1a5f4-bca8-447c-a156-1a25e77e15ef tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:34.111052 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-8da1a5f4-bca8-447c-a156-1a25e77e15ef tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:34.114983 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-8da1a5f4-bca8-447c-a156-1a25e77e15ef tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:34.347716 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-029fffd6-6b49-4b22-946a-a3d2861d3891 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:37:34.349490 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-029fffd6-6b49-4b22-946a-a3d2861d3891 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] [instance: 59ad64a5-af93-44ef-8031-fd2f2d18a901] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:37:34.356163 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-029fffd6-6b49-4b22-946a-a3d2861d3891 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:34.356612 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-029fffd6-6b49-4b22-946a-a3d2861d3891 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:34.357447 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-029fffd6-6b49-4b22-946a-a3d2861d3891 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:34.357875 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-029fffd6-6b49-4b22-946a-a3d2861d3891 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:34.393250 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-8da1a5f4-bca8-447c-a156-1a25e77e15ef tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db87258db1424ce7a8399fdd05efe3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89d1b21ad8471a8a9a82adac2594c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:37:34.413737 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-8da1a5f4-bca8-447c-a156-1a25e77e15ef tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] 10.222.0.45 "GET /compute/v2.1/servers/4e67b25e-7e65-4975-bafa-fceafcd53647" status: 200 len: 1520 microversion: 2.1 time: 0.329257 Jan 21 09:37:34.413737 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 158/329] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:37:34 2022] GET /compute/v2.1/servers/4e67b25e-7e65-4975-bafa-fceafcd53647 => generated 1520 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:37:34.466776 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-029fffd6-6b49-4b22-946a-a3d2861d3891 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "POST /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901/action" status: 200 len: 35318 microversion: 2.20 time: 0.121612 Jan 21 09:37:34.472357 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 172/330] 10.222.0.45 () {62 vars in 1318 bytes} [Fri Jan 21 09:37:34 2022] POST /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901/action => generated 35318 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 21 09:37:34.475828 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-5d1d56bb-87eb-4f39-9f98-592e041ab414 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:37:34.476715 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-5d1d56bb-87eb-4f39-9f98-592e041ab414 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] [instance: c2cf8bdb-ca1e-40cb-b09a-58e8e59a213f] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:37:34.494233 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-5d1d56bb-87eb-4f39-9f98-592e041ab414 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:34.498249 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-5d1d56bb-87eb-4f39-9f98-592e041ab414 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:34.498249 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-5d1d56bb-87eb-4f39-9f98-592e041ab414 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:34.498249 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-5d1d56bb-87eb-4f39-9f98-592e041ab414 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:34.653129 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-5d1d56bb-87eb-4f39-9f98-592e041ab414 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7233857fe3a341b78e6449904cd935bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1d230932114019a989885b46cb9283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:37:34.673927 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-5d1d56bb-87eb-4f39-9f98-592e041ab414 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] 10.222.0.45 "GET /compute/v2.1/servers/c2cf8bdb-ca1e-40cb-b09a-58e8e59a213f" status: 200 len: 1272 microversion: 2.1 time: 0.203761 Jan 21 09:37:34.674593 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 159/331] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:37:34 2022] GET /compute/v2.1/servers/c2cf8bdb-ca1e-40cb-b09a-58e8e59a213f => generated 1272 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:37:34.800277 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-e5c45f1b-a258-4180-bef9-14c787c70565 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:37:34.801028 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-e5c45f1b-a258-4180-bef9-14c787c70565 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] [instance: ad91ae0f-410b-479b-82f5-c0e18d325a8b] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:37:34.808307 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-e5c45f1b-a258-4180-bef9-14c787c70565 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:34.808628 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-e5c45f1b-a258-4180-bef9-14c787c70565 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:34.809480 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-e5c45f1b-a258-4180-bef9-14c787c70565 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:34.810206 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-e5c45f1b-a258-4180-bef9-14c787c70565 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:35.271921 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-e5c45f1b-a258-4180-bef9-14c787c70565 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7b2c14d9444d65ab7a874e749671bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3390729231b409e9a83376b428c1a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:37:35.286729 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-e5c45f1b-a258-4180-bef9-14c787c70565 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] 10.222.0.45 "GET /compute/v2.1/servers/ad91ae0f-410b-479b-82f5-c0e18d325a8b" status: 200 len: 1318 microversion: 2.1 time: 0.488520 Jan 21 09:37:35.287361 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 173/332] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:37:34 2022] GET /compute/v2.1/servers/ad91ae0f-410b-479b-82f5-c0e18d325a8b => generated 1318 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:37:35.427682 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-eb903b05-9db6-482b-9fa6-450328a57368 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:37:35.428259 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-eb903b05-9db6-482b-9fa6-450328a57368 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] [instance: 4e67b25e-7e65-4975-bafa-fceafcd53647] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:37:35.446332 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-eb903b05-9db6-482b-9fa6-450328a57368 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:35.447207 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-eb903b05-9db6-482b-9fa6-450328a57368 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:35.448189 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-eb903b05-9db6-482b-9fa6-450328a57368 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:35.448785 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-eb903b05-9db6-482b-9fa6-450328a57368 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:35.482001 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-414cdb99-6927-4eae-a0f5-d9eeffcb26d7 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:37:35.484238 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-414cdb99-6927-4eae-a0f5-d9eeffcb26d7 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] [instance: 59ad64a5-af93-44ef-8031-fd2f2d18a901] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:37:35.507668 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-414cdb99-6927-4eae-a0f5-d9eeffcb26d7 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:35.508405 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-414cdb99-6927-4eae-a0f5-d9eeffcb26d7 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:35.509739 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-414cdb99-6927-4eae-a0f5-d9eeffcb26d7 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:35.510593 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-414cdb99-6927-4eae-a0f5-d9eeffcb26d7 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:35.638190 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-414cdb99-6927-4eae-a0f5-d9eeffcb26d7 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "POST /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901/action" status: 200 len: 36462 microversion: 2.20 time: 0.160976 Jan 21 09:37:35.638958 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 174/333] 10.222.0.45 () {62 vars in 1318 bytes} [Fri Jan 21 09:37:35 2022] POST /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901/action => generated 36462 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 21 09:37:35.699031 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-1759b8de-9401-4a43-869b-16e93a0987a3 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:37:35.699771 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-1759b8de-9401-4a43-869b-16e93a0987a3 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] [instance: c2cf8bdb-ca1e-40cb-b09a-58e8e59a213f] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:37:35.710686 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-1759b8de-9401-4a43-869b-16e93a0987a3 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:35.711466 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-1759b8de-9401-4a43-869b-16e93a0987a3 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:35.712514 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-1759b8de-9401-4a43-869b-16e93a0987a3 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:35.713320 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-1759b8de-9401-4a43-869b-16e93a0987a3 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:36.278987 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-eb903b05-9db6-482b-9fa6-450328a57368 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db87258db1424ce7a8399fdd05efe3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89d1b21ad8471a8a9a82adac2594c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:37:36.292550 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-eb903b05-9db6-482b-9fa6-450328a57368 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] 10.222.0.45 "GET /compute/v2.1/servers/4e67b25e-7e65-4975-bafa-fceafcd53647" status: 200 len: 1520 microversion: 2.1 time: 0.869272 Jan 21 09:37:36.305579 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 160/334] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:37:35 2022] GET /compute/v2.1/servers/4e67b25e-7e65-4975-bafa-fceafcd53647 => generated 1520 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:37:36.311433 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-e13607f6-84e6-4b1a-8003-359ab0c9fae6 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:37:36.312825 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-e13607f6-84e6-4b1a-8003-359ab0c9fae6 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] [instance: ad91ae0f-410b-479b-82f5-c0e18d325a8b] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:37:36.321692 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-e13607f6-84e6-4b1a-8003-359ab0c9fae6 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:36.322535 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-e13607f6-84e6-4b1a-8003-359ab0c9fae6 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:36.324760 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-e13607f6-84e6-4b1a-8003-359ab0c9fae6 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:36.325509 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-e13607f6-84e6-4b1a-8003-359ab0c9fae6 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:36.345245 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-1759b8de-9401-4a43-869b-16e93a0987a3 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7233857fe3a341b78e6449904cd935bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1d230932114019a989885b46cb9283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:37:36.354932 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-1759b8de-9401-4a43-869b-16e93a0987a3 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] 10.222.0.45 "GET /compute/v2.1/servers/c2cf8bdb-ca1e-40cb-b09a-58e8e59a213f" status: 200 len: 1314 microversion: 2.1 time: 0.661140 Jan 21 09:37:36.356250 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 175/335] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:37:35 2022] GET /compute/v2.1/servers/c2cf8bdb-ca1e-40cb-b09a-58e8e59a213f => generated 1314 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 09:37:36.659840 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-4c105362-51f3-422a-9848-4e71e4cf079e tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:37:36.659840 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-4c105362-51f3-422a-9848-4e71e4cf079e tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] [instance: 59ad64a5-af93-44ef-8031-fd2f2d18a901] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:37:36.660686 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-4c105362-51f3-422a-9848-4e71e4cf079e tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:36.661345 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-4c105362-51f3-422a-9848-4e71e4cf079e tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:36.662349 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-4c105362-51f3-422a-9848-4e71e4cf079e tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:36.662780 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-4c105362-51f3-422a-9848-4e71e4cf079e tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:36.685780 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-e13607f6-84e6-4b1a-8003-359ab0c9fae6 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7b2c14d9444d65ab7a874e749671bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3390729231b409e9a83376b428c1a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:37:36.702490 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-e13607f6-84e6-4b1a-8003-359ab0c9fae6 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] 10.222.0.45 "GET /compute/v2.1/servers/ad91ae0f-410b-479b-82f5-c0e18d325a8b" status: 200 len: 1318 microversion: 2.1 time: 0.395443 Jan 21 09:37:36.714314 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 161/336] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:37:36 2022] GET /compute/v2.1/servers/ad91ae0f-410b-479b-82f5-c0e18d325a8b => generated 1318 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:37:36.781687 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-4c105362-51f3-422a-9848-4e71e4cf079e tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "POST /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901/action" status: 200 len: 37156 microversion: 2.20 time: 0.133808 Jan 21 09:37:36.783115 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 176/337] 10.222.0.45 () {62 vars in 1318 bytes} [Fri Jan 21 09:37:36 2022] POST /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901/action => generated 37156 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 21 09:37:37.311030 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-10ff3a72-c0ce-4256-8175-a184ce1f2909 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:37:37.311635 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-10ff3a72-c0ce-4256-8175-a184ce1f2909 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] [instance: 4e67b25e-7e65-4975-bafa-fceafcd53647] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:37:37.328778 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-10ff3a72-c0ce-4256-8175-a184ce1f2909 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:37.329322 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-10ff3a72-c0ce-4256-8175-a184ce1f2909 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:37.330140 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-10ff3a72-c0ce-4256-8175-a184ce1f2909 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:37.330575 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-10ff3a72-c0ce-4256-8175-a184ce1f2909 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:37.361035 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [req-22997f1a-1717-46e7-934c-bed787f8d61e req-60bf1cd8-57fd-4ad7-b437-34f52a587823 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad91ae0f-410b-479b-82f5-c0e18d325a8b", "name": "network-vif-plugged", "status": "completed", "tag": "57b1afe5-3070-43a1-9f90-584240e66081"}]} {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:37:37.362849 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 21 09:37:37.362849 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: warnings.warn(msg) Jan 21 09:37:37.392348 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [req-22997f1a-1717-46e7-934c-bed787f8d61e req-60bf1cd8-57fd-4ad7-b437-34f52a587823 service nova] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:37.392348 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [req-22997f1a-1717-46e7-934c-bed787f8d61e req-60bf1cd8-57fd-4ad7-b437-34f52a587823 service nova] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:37.437605 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.compute.server_external_events [req-22997f1a-1717-46e7-934c-bed787f8d61e req-60bf1cd8-57fd-4ad7-b437-34f52a587823 service nova] Creating event network-vif-plugged:57b1afe5-3070-43a1-9f90-584240e66081 for instance ad91ae0f-410b-479b-82f5-c0e18d325a8b on hv-cinder-80403 Jan 21 09:37:37.446973 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [req-22997f1a-1717-46e7-934c-bed787f8d61e req-60bf1cd8-57fd-4ad7-b437-34f52a587823 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089253 Jan 21 09:37:37.448513 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 177/338] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Jan 21 09:37:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 21 09:37:37.456808 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-28e26be4-f39b-488b-8dad-bb4a9bd342e5 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:37:37.458784 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-28e26be4-f39b-488b-8dad-bb4a9bd342e5 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] [instance: c2cf8bdb-ca1e-40cb-b09a-58e8e59a213f] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:37:37.467009 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-28e26be4-f39b-488b-8dad-bb4a9bd342e5 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:37.468386 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-28e26be4-f39b-488b-8dad-bb4a9bd342e5 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:37.469522 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-28e26be4-f39b-488b-8dad-bb4a9bd342e5 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:37.470465 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-28e26be4-f39b-488b-8dad-bb4a9bd342e5 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:38.125599 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-10ff3a72-c0ce-4256-8175-a184ce1f2909 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db87258db1424ce7a8399fdd05efe3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89d1b21ad8471a8a9a82adac2594c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:37:38.150012 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-10ff3a72-c0ce-4256-8175-a184ce1f2909 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] 10.222.0.45 "GET /compute/v2.1/servers/4e67b25e-7e65-4975-bafa-fceafcd53647" status: 200 len: 1520 microversion: 2.1 time: 0.840704 Jan 21 09:37:38.150012 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 162/339] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:37:37 2022] GET /compute/v2.1/servers/4e67b25e-7e65-4975-bafa-fceafcd53647 => generated 1520 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:37:38.154654 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [req-77d69d16-35a6-4acf-aee7-de7a5bf9584b req-f639c5f4-a718-42fa-a1ea-e67066364b7e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c2cf8bdb-ca1e-40cb-b09a-58e8e59a213f", "tag": "6bb3a0f1-e345-49d2-b142-75f408fac434"}]} {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:37:38.158160 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 21 09:37:38.158160 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: warnings.warn(msg) Jan 21 09:37:38.171187 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [req-77d69d16-35a6-4acf-aee7-de7a5bf9584b req-f639c5f4-a718-42fa-a1ea-e67066364b7e service nova] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:38.175452 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [req-77d69d16-35a6-4acf-aee7-de7a5bf9584b req-f639c5f4-a718-42fa-a1ea-e67066364b7e service nova] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:38.188535 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.compute.server_external_events [req-77d69d16-35a6-4acf-aee7-de7a5bf9584b req-f639c5f4-a718-42fa-a1ea-e67066364b7e service nova] Creating event network-changed:6bb3a0f1-e345-49d2-b142-75f408fac434 for instance c2cf8bdb-ca1e-40cb-b09a-58e8e59a213f on hv-cinder-80403 Jan 21 09:37:38.196557 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [req-77d69d16-35a6-4acf-aee7-de7a5bf9584b req-f639c5f4-a718-42fa-a1ea-e67066364b7e service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045864 Jan 21 09:37:38.197217 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 163/340] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Jan 21 09:37:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 09:37:38.202949 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-ffb8f0c6-1e40-456a-bf27-23b6da0c97e8 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:37:38.203687 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-ffb8f0c6-1e40-456a-bf27-23b6da0c97e8 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] [instance: ad91ae0f-410b-479b-82f5-c0e18d325a8b] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:37:38.212243 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-ffb8f0c6-1e40-456a-bf27-23b6da0c97e8 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:38.212697 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-ffb8f0c6-1e40-456a-bf27-23b6da0c97e8 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:38.213665 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-ffb8f0c6-1e40-456a-bf27-23b6da0c97e8 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:38.214065 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-ffb8f0c6-1e40-456a-bf27-23b6da0c97e8 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:38.230554 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-28e26be4-f39b-488b-8dad-bb4a9bd342e5 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7233857fe3a341b78e6449904cd935bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1d230932114019a989885b46cb9283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:37:38.257385 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-28e26be4-f39b-488b-8dad-bb4a9bd342e5 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] 10.222.0.45 "GET /compute/v2.1/servers/c2cf8bdb-ca1e-40cb-b09a-58e8e59a213f" status: 200 len: 1314 microversion: 2.1 time: 0.806789 Jan 21 09:37:38.260911 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 178/341] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:37:37 2022] GET /compute/v2.1/servers/c2cf8bdb-ca1e-40cb-b09a-58e8e59a213f => generated 1314 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:37:38.274676 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-5208a8e4-12f9-4507-9b63-2ebe748743e4 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:37:38.277688 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-5208a8e4-12f9-4507-9b63-2ebe748743e4 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] [instance: 59ad64a5-af93-44ef-8031-fd2f2d18a901] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:37:38.294321 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-5208a8e4-12f9-4507-9b63-2ebe748743e4 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:38.295407 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-5208a8e4-12f9-4507-9b63-2ebe748743e4 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:38.297246 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-5208a8e4-12f9-4507-9b63-2ebe748743e4 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:38.300478 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-5208a8e4-12f9-4507-9b63-2ebe748743e4 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:38.431177 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-5208a8e4-12f9-4507-9b63-2ebe748743e4 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "POST /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901/action" status: 200 len: 38172 microversion: 2.20 time: 0.168061 Jan 21 09:37:38.432109 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 179/342] 10.222.0.45 () {62 vars in 1318 bytes} [Fri Jan 21 09:37:38 2022] POST /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901/action => generated 38172 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 21 09:37:38.822909 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-ffb8f0c6-1e40-456a-bf27-23b6da0c97e8 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7b2c14d9444d65ab7a874e749671bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3390729231b409e9a83376b428c1a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:37:38.830545 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-ffb8f0c6-1e40-456a-bf27-23b6da0c97e8 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] 10.222.0.45 "GET /compute/v2.1/servers/ad91ae0f-410b-479b-82f5-c0e18d325a8b" status: 200 len: 1318 microversion: 2.1 time: 0.631785 Jan 21 09:37:38.831235 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 164/343] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:37:38 2022] GET /compute/v2.1/servers/ad91ae0f-410b-479b-82f5-c0e18d325a8b => generated 1318 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:37:39.174366 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-8a026ef9-58c3-40bd-9018-6271f1d245a0 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:37:39.175344 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-8a026ef9-58c3-40bd-9018-6271f1d245a0 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] [instance: 4e67b25e-7e65-4975-bafa-fceafcd53647] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:37:39.186136 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-8a026ef9-58c3-40bd-9018-6271f1d245a0 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:39.186612 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-8a026ef9-58c3-40bd-9018-6271f1d245a0 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:39.187382 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-8a026ef9-58c3-40bd-9018-6271f1d245a0 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:39.187816 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-8a026ef9-58c3-40bd-9018-6271f1d245a0 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:39.302689 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-ee4d47e5-8b83-49f4-a3c2-ba3db8328edb tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:37:39.304450 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-ee4d47e5-8b83-49f4-a3c2-ba3db8328edb tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] [instance: c2cf8bdb-ca1e-40cb-b09a-58e8e59a213f] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:37:39.314972 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-ee4d47e5-8b83-49f4-a3c2-ba3db8328edb tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:39.315965 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-ee4d47e5-8b83-49f4-a3c2-ba3db8328edb tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:39.319623 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-ee4d47e5-8b83-49f4-a3c2-ba3db8328edb tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:39.320402 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-ee4d47e5-8b83-49f4-a3c2-ba3db8328edb tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:39.578435 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-8a026ef9-58c3-40bd-9018-6271f1d245a0 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db87258db1424ce7a8399fdd05efe3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89d1b21ad8471a8a9a82adac2594c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:37:39.590170 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-8a026ef9-58c3-40bd-9018-6271f1d245a0 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] 10.222.0.45 "GET /compute/v2.1/servers/4e67b25e-7e65-4975-bafa-fceafcd53647" status: 200 len: 1520 microversion: 2.1 time: 0.420719 Jan 21 09:37:39.591051 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 180/344] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:37:39 2022] GET /compute/v2.1/servers/4e67b25e-7e65-4975-bafa-fceafcd53647 => generated 1520 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:37:39.603456 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-ebb004e6-c906-4efc-a7c0-5309358d09bb tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:37:39.604770 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-ebb004e6-c906-4efc-a7c0-5309358d09bb tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] [instance: 59ad64a5-af93-44ef-8031-fd2f2d18a901] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:37:39.628311 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-ebb004e6-c906-4efc-a7c0-5309358d09bb tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:39.630225 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-ebb004e6-c906-4efc-a7c0-5309358d09bb tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:39.631360 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-ebb004e6-c906-4efc-a7c0-5309358d09bb tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:39.638414 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-ebb004e6-c906-4efc-a7c0-5309358d09bb tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:39.734551 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-ee4d47e5-8b83-49f4-a3c2-ba3db8328edb tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7233857fe3a341b78e6449904cd935bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1d230932114019a989885b46cb9283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:37:39.752542 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-ee4d47e5-8b83-49f4-a3c2-ba3db8328edb tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] 10.222.0.45 "GET /compute/v2.1/servers/c2cf8bdb-ca1e-40cb-b09a-58e8e59a213f" status: 200 len: 1314 microversion: 2.1 time: 0.472873 Jan 21 09:37:39.765396 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 165/345] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:37:39 2022] GET /compute/v2.1/servers/c2cf8bdb-ca1e-40cb-b09a-58e8e59a213f => generated 1314 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:37:39.810627 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-ebb004e6-c906-4efc-a7c0-5309358d09bb tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "POST /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901/action" status: 200 len: 38172 microversion: 2.20 time: 0.217295 Jan 21 09:37:39.816430 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 181/346] 10.222.0.45 () {62 vars in 1318 bytes} [Fri Jan 21 09:37:39 2022] POST /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901/action => generated 38172 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 21 09:37:39.856546 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-b6589cdd-da81-4ef0-9e0d-7148f21426fe tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:37:39.857461 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-b6589cdd-da81-4ef0-9e0d-7148f21426fe tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] [instance: ad91ae0f-410b-479b-82f5-c0e18d325a8b] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:37:39.870537 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-b6589cdd-da81-4ef0-9e0d-7148f21426fe tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:39.874116 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-b6589cdd-da81-4ef0-9e0d-7148f21426fe tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:39.875125 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-b6589cdd-da81-4ef0-9e0d-7148f21426fe tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:39.875750 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-b6589cdd-da81-4ef0-9e0d-7148f21426fe tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:40.431153 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-b6589cdd-da81-4ef0-9e0d-7148f21426fe tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7b2c14d9444d65ab7a874e749671bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3390729231b409e9a83376b428c1a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:37:40.442403 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-b6589cdd-da81-4ef0-9e0d-7148f21426fe tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] 10.222.0.45 "GET /compute/v2.1/servers/ad91ae0f-410b-479b-82f5-c0e18d325a8b" status: 200 len: 1318 microversion: 2.1 time: 0.598436 Jan 21 09:37:40.443070 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 166/347] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:37:39 2022] GET /compute/v2.1/servers/ad91ae0f-410b-479b-82f5-c0e18d325a8b => generated 1318 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:37:40.620367 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-093e9786-5676-4b20-8599-e9183557a146 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:37:40.621530 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-093e9786-5676-4b20-8599-e9183557a146 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] [instance: 4e67b25e-7e65-4975-bafa-fceafcd53647] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:37:40.634528 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-093e9786-5676-4b20-8599-e9183557a146 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:40.635359 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-093e9786-5676-4b20-8599-e9183557a146 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:40.636447 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-093e9786-5676-4b20-8599-e9183557a146 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:40.637098 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-093e9786-5676-4b20-8599-e9183557a146 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:40.772597 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-504e7f96-3ddb-47a9-89e1-027d13769506 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:37:40.773380 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-504e7f96-3ddb-47a9-89e1-027d13769506 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] [instance: c2cf8bdb-ca1e-40cb-b09a-58e8e59a213f] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:37:40.785776 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-504e7f96-3ddb-47a9-89e1-027d13769506 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:40.786326 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-504e7f96-3ddb-47a9-89e1-027d13769506 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:40.787146 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-504e7f96-3ddb-47a9-89e1-027d13769506 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:40.788830 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-504e7f96-3ddb-47a9-89e1-027d13769506 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:41.005793 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-093e9786-5676-4b20-8599-e9183557a146 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db87258db1424ce7a8399fdd05efe3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89d1b21ad8471a8a9a82adac2594c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:37:41.022901 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-093e9786-5676-4b20-8599-e9183557a146 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] 10.222.0.45 "GET /compute/v2.1/servers/4e67b25e-7e65-4975-bafa-fceafcd53647" status: 200 len: 1520 microversion: 2.1 time: 0.416237 Jan 21 09:37:41.033009 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 182/348] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:37:40 2022] GET /compute/v2.1/servers/4e67b25e-7e65-4975-bafa-fceafcd53647 => generated 1520 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:37:41.037663 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-8eeed140-cb4f-40e0-b503-73dae200a127 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:37:41.039594 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-8eeed140-cb4f-40e0-b503-73dae200a127 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] [instance: 59ad64a5-af93-44ef-8031-fd2f2d18a901] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:37:41.050674 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-8eeed140-cb4f-40e0-b503-73dae200a127 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:41.051006 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-8eeed140-cb4f-40e0-b503-73dae200a127 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:41.057931 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-8eeed140-cb4f-40e0-b503-73dae200a127 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:41.057931 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-8eeed140-cb4f-40e0-b503-73dae200a127 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:41.149173 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-504e7f96-3ddb-47a9-89e1-027d13769506 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7233857fe3a341b78e6449904cd935bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1d230932114019a989885b46cb9283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:37:41.157259 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-504e7f96-3ddb-47a9-89e1-027d13769506 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] 10.222.0.45 "GET /compute/v2.1/servers/c2cf8bdb-ca1e-40cb-b09a-58e8e59a213f" status: 200 len: 1314 microversion: 2.1 time: 0.389166 Jan 21 09:37:41.157831 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 167/349] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:37:40 2022] GET /compute/v2.1/servers/c2cf8bdb-ca1e-40cb-b09a-58e8e59a213f => generated 1314 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:37:41.182256 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-8eeed140-cb4f-40e0-b503-73dae200a127 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "POST /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901/action" status: 200 len: 38315 microversion: 2.20 time: 0.154688 Jan 21 09:37:41.182846 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 183/350] 10.222.0.45 () {62 vars in 1318 bytes} [Fri Jan 21 09:37:41 2022] POST /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901/action => generated 38315 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 21 09:37:41.197959 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-81d8a839-9f76-4be2-b12c-c4619f67bf03 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:37:41.198657 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-81d8a839-9f76-4be2-b12c-c4619f67bf03 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] [instance: 59ad64a5-af93-44ef-8031-fd2f2d18a901] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:37:41.208743 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-81d8a839-9f76-4be2-b12c-c4619f67bf03 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:41.209777 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-81d8a839-9f76-4be2-b12c-c4619f67bf03 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:41.211989 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-81d8a839-9f76-4be2-b12c-c4619f67bf03 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:41.212736 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-81d8a839-9f76-4be2-b12c-c4619f67bf03 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:41.251587 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-81d8a839-9f76-4be2-b12c-c4619f67bf03 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "GET /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901/ips" status: 200 len: 152 microversion: 2.20 time: 0.061345 Jan 21 09:37:41.252597 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 168/351] 10.222.0.45 () {60 vars in 1288 bytes} [Fri Jan 21 09:37:41 2022] GET /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901/ips => generated 152 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 21 09:37:41.461269 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-0424d431-4184-42ff-b078-7fb4b47accb9 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:37:41.462002 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-0424d431-4184-42ff-b078-7fb4b47accb9 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] [instance: ad91ae0f-410b-479b-82f5-c0e18d325a8b] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:37:41.471760 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-0424d431-4184-42ff-b078-7fb4b47accb9 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:41.472202 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-0424d431-4184-42ff-b078-7fb4b47accb9 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:41.475573 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-0424d431-4184-42ff-b078-7fb4b47accb9 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:41.481239 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-0424d431-4184-42ff-b078-7fb4b47accb9 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:41.985948 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-0424d431-4184-42ff-b078-7fb4b47accb9 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7b2c14d9444d65ab7a874e749671bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3390729231b409e9a83376b428c1a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:37:41.997359 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-0424d431-4184-42ff-b078-7fb4b47accb9 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] 10.222.0.45 "GET /compute/v2.1/servers/ad91ae0f-410b-479b-82f5-c0e18d325a8b" status: 200 len: 1508 microversion: 2.1 time: 0.541151 Jan 21 09:37:42.010203 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 184/352] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:37:41 2022] GET /compute/v2.1/servers/ad91ae0f-410b-479b-82f5-c0e18d325a8b => generated 1508 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:37:42.043554 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-fcf2c738-561a-4edb-b72f-cd92fbd5517f tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:37:42.044419 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-fcf2c738-561a-4edb-b72f-cd92fbd5517f tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] [instance: 4e67b25e-7e65-4975-bafa-fceafcd53647] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:37:42.074400 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-fcf2c738-561a-4edb-b72f-cd92fbd5517f tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:42.078286 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-fcf2c738-561a-4edb-b72f-cd92fbd5517f tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:42.080410 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-fcf2c738-561a-4edb-b72f-cd92fbd5517f tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:42.080920 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-fcf2c738-561a-4edb-b72f-cd92fbd5517f tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:42.173965 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-35b2fd5d-cf38-45a5-82c0-a2ab52a8b68c tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:37:42.174757 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-35b2fd5d-cf38-45a5-82c0-a2ab52a8b68c tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] [instance: c2cf8bdb-ca1e-40cb-b09a-58e8e59a213f] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:37:42.191158 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-35b2fd5d-cf38-45a5-82c0-a2ab52a8b68c tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:42.191871 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-35b2fd5d-cf38-45a5-82c0-a2ab52a8b68c tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:42.202776 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-35b2fd5d-cf38-45a5-82c0-a2ab52a8b68c tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:42.204620 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-35b2fd5d-cf38-45a5-82c0-a2ab52a8b68c tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:42.425476 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-fcf2c738-561a-4edb-b72f-cd92fbd5517f tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db87258db1424ce7a8399fdd05efe3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89d1b21ad8471a8a9a82adac2594c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:37:42.437890 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-fcf2c738-561a-4edb-b72f-cd92fbd5517f tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] 10.222.0.45 "GET /compute/v2.1/servers/4e67b25e-7e65-4975-bafa-fceafcd53647" status: 200 len: 1520 microversion: 2.1 time: 0.399369 Jan 21 09:37:42.439537 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 169/353] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:37:42 2022] GET /compute/v2.1/servers/4e67b25e-7e65-4975-bafa-fceafcd53647 => generated 1520 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:37:42.484518 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-35b2fd5d-cf38-45a5-82c0-a2ab52a8b68c tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7233857fe3a341b78e6449904cd935bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1d230932114019a989885b46cb9283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:37:42.494475 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-35b2fd5d-cf38-45a5-82c0-a2ab52a8b68c tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] 10.222.0.45 "GET /compute/v2.1/servers/c2cf8bdb-ca1e-40cb-b09a-58e8e59a213f" status: 200 len: 1314 microversion: 2.1 time: 0.324661 Jan 21 09:37:42.505581 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 185/354] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:37:42 2022] GET /compute/v2.1/servers/c2cf8bdb-ca1e-40cb-b09a-58e8e59a213f => generated 1314 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 09:37:43.455731 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-b109f076-45bd-44e4-a5fe-961869404fba tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:37:43.456339 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-b109f076-45bd-44e4-a5fe-961869404fba tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] [instance: 4e67b25e-7e65-4975-bafa-fceafcd53647] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:37:43.463790 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-b109f076-45bd-44e4-a5fe-961869404fba tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:43.464028 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-b109f076-45bd-44e4-a5fe-961869404fba tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:43.465061 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-b109f076-45bd-44e4-a5fe-961869404fba tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:43.465626 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-b109f076-45bd-44e4-a5fe-961869404fba tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:43.513743 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-216b525b-249b-496b-9260-8750e8e64803 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:37:43.514636 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-216b525b-249b-496b-9260-8750e8e64803 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] [instance: c2cf8bdb-ca1e-40cb-b09a-58e8e59a213f] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:37:43.547823 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-216b525b-249b-496b-9260-8750e8e64803 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:43.552491 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-216b525b-249b-496b-9260-8750e8e64803 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:43.555691 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-216b525b-249b-496b-9260-8750e8e64803 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:43.556203 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-216b525b-249b-496b-9260-8750e8e64803 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:43.784911 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-b109f076-45bd-44e4-a5fe-961869404fba tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db87258db1424ce7a8399fdd05efe3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89d1b21ad8471a8a9a82adac2594c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:37:43.807897 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-b109f076-45bd-44e4-a5fe-961869404fba tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] 10.222.0.45 "GET /compute/v2.1/servers/4e67b25e-7e65-4975-bafa-fceafcd53647" status: 200 len: 1520 microversion: 2.1 time: 0.355785 Jan 21 09:37:43.819760 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 170/355] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:37:43 2022] GET /compute/v2.1/servers/4e67b25e-7e65-4975-bafa-fceafcd53647 => generated 1520 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:37:43.958993 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-216b525b-249b-496b-9260-8750e8e64803 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7233857fe3a341b78e6449904cd935bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1d230932114019a989885b46cb9283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:37:43.974047 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-216b525b-249b-496b-9260-8750e8e64803 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] 10.222.0.45 "GET /compute/v2.1/servers/c2cf8bdb-ca1e-40cb-b09a-58e8e59a213f" status: 200 len: 1314 microversion: 2.1 time: 0.459076 Jan 21 09:37:43.975547 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 186/356] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:37:43 2022] GET /compute/v2.1/servers/c2cf8bdb-ca1e-40cb-b09a-58e8e59a213f => generated 1314 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:37:44.837399 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-b19fa737-9ef3-4546-b09b-989128097d88 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:37:44.839104 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-b19fa737-9ef3-4546-b09b-989128097d88 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] [instance: 4e67b25e-7e65-4975-bafa-fceafcd53647] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:37:44.846578 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-b19fa737-9ef3-4546-b09b-989128097d88 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:44.847037 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-b19fa737-9ef3-4546-b09b-989128097d88 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:44.849325 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-b19fa737-9ef3-4546-b09b-989128097d88 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:44.849787 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-b19fa737-9ef3-4546-b09b-989128097d88 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:45.005916 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-a2f2af18-e7a3-426a-bf9d-f01feefd8c22 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:37:45.005916 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-a2f2af18-e7a3-426a-bf9d-f01feefd8c22 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] [instance: c2cf8bdb-ca1e-40cb-b09a-58e8e59a213f] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:37:45.015022 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-a2f2af18-e7a3-426a-bf9d-f01feefd8c22 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:45.015478 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-a2f2af18-e7a3-426a-bf9d-f01feefd8c22 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:45.016778 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-a2f2af18-e7a3-426a-bf9d-f01feefd8c22 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:45.017938 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-a2f2af18-e7a3-426a-bf9d-f01feefd8c22 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:45.084212 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-b19fa737-9ef3-4546-b09b-989128097d88 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db87258db1424ce7a8399fdd05efe3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89d1b21ad8471a8a9a82adac2594c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:37:45.094350 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-b19fa737-9ef3-4546-b09b-989128097d88 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] 10.222.0.45 "GET /compute/v2.1/servers/4e67b25e-7e65-4975-bafa-fceafcd53647" status: 200 len: 1520 microversion: 2.1 time: 0.261132 Jan 21 09:37:45.096563 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 171/357] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:37:44 2022] GET /compute/v2.1/servers/4e67b25e-7e65-4975-bafa-fceafcd53647 => generated 1520 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:37:45.353526 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-a2f2af18-e7a3-426a-bf9d-f01feefd8c22 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7233857fe3a341b78e6449904cd935bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1d230932114019a989885b46cb9283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:37:45.361642 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-a2f2af18-e7a3-426a-bf9d-f01feefd8c22 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] 10.222.0.45 "GET /compute/v2.1/servers/c2cf8bdb-ca1e-40cb-b09a-58e8e59a213f" status: 200 len: 1314 microversion: 2.1 time: 0.372896 Jan 21 09:37:45.362494 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 187/358] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:37:44 2022] GET /compute/v2.1/servers/c2cf8bdb-ca1e-40cb-b09a-58e8e59a213f => generated 1314 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:37:46.113579 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-fb01118b-dc75-40df-9368-9b0405cc03ca tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:37:46.115498 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-fb01118b-dc75-40df-9368-9b0405cc03ca tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] [instance: 4e67b25e-7e65-4975-bafa-fceafcd53647] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:37:46.133936 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-fb01118b-dc75-40df-9368-9b0405cc03ca tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:46.136099 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-fb01118b-dc75-40df-9368-9b0405cc03ca tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:46.138952 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-fb01118b-dc75-40df-9368-9b0405cc03ca tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:46.145131 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-fb01118b-dc75-40df-9368-9b0405cc03ca tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:46.369174 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-fb01118b-dc75-40df-9368-9b0405cc03ca tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db87258db1424ce7a8399fdd05efe3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89d1b21ad8471a8a9a82adac2594c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:37:46.387765 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-ea232ce9-5a63-4585-bd53-91549b73d3c0 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:37:46.388658 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-ea232ce9-5a63-4585-bd53-91549b73d3c0 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] [instance: c2cf8bdb-ca1e-40cb-b09a-58e8e59a213f] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:37:46.401610 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-ea232ce9-5a63-4585-bd53-91549b73d3c0 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:46.405620 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-ea232ce9-5a63-4585-bd53-91549b73d3c0 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:46.405620 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-ea232ce9-5a63-4585-bd53-91549b73d3c0 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:46.405807 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-fb01118b-dc75-40df-9368-9b0405cc03ca tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] 10.222.0.45 "GET /compute/v2.1/servers/4e67b25e-7e65-4975-bafa-fceafcd53647" status: 200 len: 1520 microversion: 2.1 time: 0.294835 Jan 21 09:37:46.405893 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-ea232ce9-5a63-4585-bd53-91549b73d3c0 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:46.405980 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 172/359] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:37:46 2022] GET /compute/v2.1/servers/4e67b25e-7e65-4975-bafa-fceafcd53647 => generated 1520 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:37:46.479780 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-375a9872-c455-4c28-b589-a2eff5d92956 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:37:46.480357 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-375a9872-c455-4c28-b589-a2eff5d92956 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] [instance: 59ad64a5-af93-44ef-8031-fd2f2d18a901] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:37:46.487685 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-375a9872-c455-4c28-b589-a2eff5d92956 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:46.489351 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-375a9872-c455-4c28-b589-a2eff5d92956 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:46.490123 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-375a9872-c455-4c28-b589-a2eff5d92956 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:46.490569 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-375a9872-c455-4c28-b589-a2eff5d92956 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:46.522112 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.objects.instance [None req-375a9872-c455-4c28-b589-a2eff5d92956 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lazy-loading 'flavor' on Instance uuid 59ad64a5-af93-44ef-8031-fd2f2d18a901 {{(pid=123386) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 21 09:37:46.830803 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-ea232ce9-5a63-4585-bd53-91549b73d3c0 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7233857fe3a341b78e6449904cd935bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1d230932114019a989885b46cb9283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:37:46.839372 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-ea232ce9-5a63-4585-bd53-91549b73d3c0 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] 10.222.0.45 "GET /compute/v2.1/servers/c2cf8bdb-ca1e-40cb-b09a-58e8e59a213f" status: 200 len: 1314 microversion: 2.1 time: 0.463885 Jan 21 09:37:46.840046 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 188/360] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:37:46 2022] GET /compute/v2.1/servers/c2cf8bdb-ca1e-40cb-b09a-58e8e59a213f => generated 1314 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:37:47.301595 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-23facba5-3a0f-494a-b56d-76345bd0f19d tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7866bcb4-f5c0-4304-a41b-1c8bb3634d8c"}} {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:37:47.302711 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-23facba5-3a0f-494a-b56d-76345bd0f19d tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] [instance: ad91ae0f-410b-479b-82f5-c0e18d325a8b] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:37:47.310457 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-23facba5-3a0f-494a-b56d-76345bd0f19d tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:47.310907 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-23facba5-3a0f-494a-b56d-76345bd0f19d tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:47.311709 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-23facba5-3a0f-494a-b56d-76345bd0f19d tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:47.312144 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-23facba5-3a0f-494a-b56d-76345bd0f19d tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:47.503994 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-375a9872-c455-4c28-b589-a2eff5d92956 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "POST /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901/action" status: 202 len: 0 microversion: 2.20 time: 1.028376 Jan 21 09:37:47.506125 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 173/361] 10.222.0.45 () {62 vars in 1318 bytes} [Fri Jan 21 09:37:46 2022] POST /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901/action => generated 0 bytes in 1031 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jan 21 09:37:47.516743 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-b03ff003-573a-4b1e-8c93-7fd054a44a43 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:37:47.517911 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-b03ff003-573a-4b1e-8c93-7fd054a44a43 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] [instance: 4e67b25e-7e65-4975-bafa-fceafcd53647] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:37:47.525613 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-b03ff003-573a-4b1e-8c93-7fd054a44a43 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:47.526427 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-b03ff003-573a-4b1e-8c93-7fd054a44a43 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:47.527872 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-b03ff003-573a-4b1e-8c93-7fd054a44a43 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:47.528539 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-b03ff003-573a-4b1e-8c93-7fd054a44a43 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:47.870924 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-b03ff003-573a-4b1e-8c93-7fd054a44a43 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db87258db1424ce7a8399fdd05efe3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89d1b21ad8471a8a9a82adac2594c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:37:47.882509 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-b03ff003-573a-4b1e-8c93-7fd054a44a43 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] 10.222.0.45 "GET /compute/v2.1/servers/4e67b25e-7e65-4975-bafa-fceafcd53647" status: 200 len: 1520 microversion: 2.1 time: 0.371127 Jan 21 09:37:47.883085 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 174/362] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:37:47 2022] GET /compute/v2.1/servers/4e67b25e-7e65-4975-bafa-fceafcd53647 => generated 1520 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:37:47.892870 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-d02eed2c-eb6f-498f-814a-4001dc02f2c4 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:37:47.895913 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-d02eed2c-eb6f-498f-814a-4001dc02f2c4 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] [instance: 59ad64a5-af93-44ef-8031-fd2f2d18a901] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:37:47.908082 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-d02eed2c-eb6f-498f-814a-4001dc02f2c4 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:47.908796 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-d02eed2c-eb6f-498f-814a-4001dc02f2c4 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:47.911483 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-d02eed2c-eb6f-498f-814a-4001dc02f2c4 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:47.911934 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-d02eed2c-eb6f-498f-814a-4001dc02f2c4 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:48.287192 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-23facba5-3a0f-494a-b56d-76345bd0f19d tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] 10.222.0.45 "POST /compute/v2.1/servers/ad91ae0f-410b-479b-82f5-c0e18d325a8b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.990655 Jan 21 09:37:48.293546 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 189/363] 10.222.0.45 () {60 vars in 1322 bytes} [Fri Jan 21 09:37:47 2022] POST /compute/v2.1/servers/ad91ae0f-410b-479b-82f5-c0e18d325a8b/os-volume_attachments => generated 194 bytes in 998 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 09:37:48.301847 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-9872fbec-3388-4eff-96f5-c19625265606 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:37:48.304217 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-9872fbec-3388-4eff-96f5-c19625265606 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] [instance: c2cf8bdb-ca1e-40cb-b09a-58e8e59a213f] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:37:48.321009 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-9872fbec-3388-4eff-96f5-c19625265606 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:48.324919 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-9872fbec-3388-4eff-96f5-c19625265606 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:48.324919 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-9872fbec-3388-4eff-96f5-c19625265606 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:48.324919 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-9872fbec-3388-4eff-96f5-c19625265606 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:48.344510 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-d02eed2c-eb6f-498f-814a-4001dc02f2c4 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:37:48.357258 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-d02eed2c-eb6f-498f-814a-4001dc02f2c4 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:37:48.361692 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-d02eed2c-eb6f-498f-814a-4001dc02f2c4 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:37:48.368408 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-d02eed2c-eb6f-498f-814a-4001dc02f2c4 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "GET /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901" status: 200 len: 1723 microversion: 2.20 time: 0.479489 Jan 21 09:37:48.370309 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 175/364] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jan 21 09:37:47 2022] GET /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901 => generated 1723 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 21 09:37:48.533703 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [req-81e8c60e-6a92-4248-b9ba-35f895521de9 req-58b8d403-0ea6-4cb3-8d9e-262bf93b8ff0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2cf8bdb-ca1e-40cb-b09a-58e8e59a213f", "name": "network-vif-plugged", "status": "completed", "tag": "6bb3a0f1-e345-49d2-b142-75f408fac434"}]} {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:37:48.538892 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 21 09:37:48.538892 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: warnings.warn(msg) Jan 21 09:37:48.547351 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [req-81e8c60e-6a92-4248-b9ba-35f895521de9 req-58b8d403-0ea6-4cb3-8d9e-262bf93b8ff0 service nova] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:48.547990 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [req-81e8c60e-6a92-4248-b9ba-35f895521de9 req-58b8d403-0ea6-4cb3-8d9e-262bf93b8ff0 service nova] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:48.561078 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.compute.server_external_events [req-81e8c60e-6a92-4248-b9ba-35f895521de9 req-58b8d403-0ea6-4cb3-8d9e-262bf93b8ff0 service nova] Creating event network-vif-plugged:6bb3a0f1-e345-49d2-b142-75f408fac434 for instance c2cf8bdb-ca1e-40cb-b09a-58e8e59a213f on hv-cinder-80403 Jan 21 09:37:48.567346 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [req-81e8c60e-6a92-4248-b9ba-35f895521de9 req-58b8d403-0ea6-4cb3-8d9e-262bf93b8ff0 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045066 Jan 21 09:37:48.568197 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 176/365] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Jan 21 09:37:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 09:37:48.859632 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-9872fbec-3388-4eff-96f5-c19625265606 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7233857fe3a341b78e6449904cd935bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1d230932114019a989885b46cb9283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:37:48.868420 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-9872fbec-3388-4eff-96f5-c19625265606 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] 10.222.0.45 "GET /compute/v2.1/servers/c2cf8bdb-ca1e-40cb-b09a-58e8e59a213f" status: 200 len: 1314 microversion: 2.1 time: 0.572010 Jan 21 09:37:48.869343 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 190/366] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:37:48 2022] GET /compute/v2.1/servers/c2cf8bdb-ca1e-40cb-b09a-58e8e59a213f => generated 1314 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:37:48.902270 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-341d7353-d940-441b-8a15-cd04d3706bc9 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:37:48.903584 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-341d7353-d940-441b-8a15-cd04d3706bc9 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] [instance: 4e67b25e-7e65-4975-bafa-fceafcd53647] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:37:48.915676 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-341d7353-d940-441b-8a15-cd04d3706bc9 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:48.916764 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-341d7353-d940-441b-8a15-cd04d3706bc9 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:48.918510 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-341d7353-d940-441b-8a15-cd04d3706bc9 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:48.919594 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-341d7353-d940-441b-8a15-cd04d3706bc9 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:49.173496 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-341d7353-d940-441b-8a15-cd04d3706bc9 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db87258db1424ce7a8399fdd05efe3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89d1b21ad8471a8a9a82adac2594c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:37:49.183225 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-341d7353-d940-441b-8a15-cd04d3706bc9 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] 10.222.0.45 "GET /compute/v2.1/servers/4e67b25e-7e65-4975-bafa-fceafcd53647" status: 200 len: 1520 microversion: 2.1 time: 0.286369 Jan 21 09:37:49.188075 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 177/367] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:37:48 2022] GET /compute/v2.1/servers/4e67b25e-7e65-4975-bafa-fceafcd53647 => generated 1520 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:37:49.387752 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-cb150ae4-f83c-40f8-907e-0f4fdb1840b7 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:37:49.388366 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-cb150ae4-f83c-40f8-907e-0f4fdb1840b7 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] [instance: 59ad64a5-af93-44ef-8031-fd2f2d18a901] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:37:49.395495 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-cb150ae4-f83c-40f8-907e-0f4fdb1840b7 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:49.396016 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-cb150ae4-f83c-40f8-907e-0f4fdb1840b7 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:49.396823 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-cb150ae4-f83c-40f8-907e-0f4fdb1840b7 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:49.397287 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-cb150ae4-f83c-40f8-907e-0f4fdb1840b7 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:49.648462 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-cb150ae4-f83c-40f8-907e-0f4fdb1840b7 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:37:49.673369 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-cb150ae4-f83c-40f8-907e-0f4fdb1840b7 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:37:49.677336 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-cb150ae4-f83c-40f8-907e-0f4fdb1840b7 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:37:49.678943 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-cb150ae4-f83c-40f8-907e-0f4fdb1840b7 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "GET /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901" status: 200 len: 1723 microversion: 2.20 time: 0.295155 Jan 21 09:37:49.681179 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 191/368] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jan 21 09:37:49 2022] GET /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901 => generated 1723 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 21 09:37:49.885734 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-1af85c4d-13ce-466e-ae38-d3417272c963 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:37:49.886906 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-1af85c4d-13ce-466e-ae38-d3417272c963 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] [instance: c2cf8bdb-ca1e-40cb-b09a-58e8e59a213f] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:37:49.893645 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-1af85c4d-13ce-466e-ae38-d3417272c963 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:49.894014 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-1af85c4d-13ce-466e-ae38-d3417272c963 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:49.895561 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-1af85c4d-13ce-466e-ae38-d3417272c963 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:49.896101 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-1af85c4d-13ce-466e-ae38-d3417272c963 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:50.199873 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-80e614f4-2bd2-4993-b7c7-0fccca022a17 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:37:50.200745 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-80e614f4-2bd2-4993-b7c7-0fccca022a17 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] [instance: 4e67b25e-7e65-4975-bafa-fceafcd53647] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:37:50.208499 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-80e614f4-2bd2-4993-b7c7-0fccca022a17 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:50.209193 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-80e614f4-2bd2-4993-b7c7-0fccca022a17 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:50.209997 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-1af85c4d-13ce-466e-ae38-d3417272c963 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7233857fe3a341b78e6449904cd935bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1d230932114019a989885b46cb9283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:37:50.210138 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-80e614f4-2bd2-4993-b7c7-0fccca022a17 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:50.210464 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-80e614f4-2bd2-4993-b7c7-0fccca022a17 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:50.218098 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-1af85c4d-13ce-466e-ae38-d3417272c963 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] 10.222.0.45 "GET /compute/v2.1/servers/c2cf8bdb-ca1e-40cb-b09a-58e8e59a213f" status: 200 len: 1314 microversion: 2.1 time: 0.336106 Jan 21 09:37:50.219009 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 178/369] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:37:49 2022] GET /compute/v2.1/servers/c2cf8bdb-ca1e-40cb-b09a-58e8e59a213f => generated 1314 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:37:50.426530 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-80e614f4-2bd2-4993-b7c7-0fccca022a17 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db87258db1424ce7a8399fdd05efe3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89d1b21ad8471a8a9a82adac2594c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:37:50.434012 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-80e614f4-2bd2-4993-b7c7-0fccca022a17 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] 10.222.0.45 "GET /compute/v2.1/servers/4e67b25e-7e65-4975-bafa-fceafcd53647" status: 200 len: 1520 microversion: 2.1 time: 0.237857 Jan 21 09:37:50.443583 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 192/370] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:37:50 2022] GET /compute/v2.1/servers/4e67b25e-7e65-4975-bafa-fceafcd53647 => generated 1520 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:37:50.702113 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-1770e990-15ba-42e9-8d6d-48b8291e337e tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:37:50.702871 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-1770e990-15ba-42e9-8d6d-48b8291e337e tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] [instance: 59ad64a5-af93-44ef-8031-fd2f2d18a901] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:37:50.710343 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-1770e990-15ba-42e9-8d6d-48b8291e337e tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:50.710951 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-1770e990-15ba-42e9-8d6d-48b8291e337e tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:50.711885 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-1770e990-15ba-42e9-8d6d-48b8291e337e tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:50.712318 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-1770e990-15ba-42e9-8d6d-48b8291e337e tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:50.864492 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-1770e990-15ba-42e9-8d6d-48b8291e337e tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:37:50.872636 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-1770e990-15ba-42e9-8d6d-48b8291e337e tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:37:50.874158 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-1770e990-15ba-42e9-8d6d-48b8291e337e tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:37:50.875312 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-1770e990-15ba-42e9-8d6d-48b8291e337e tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "GET /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901" status: 200 len: 1723 microversion: 2.20 time: 0.178902 Jan 21 09:37:50.875875 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 179/371] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jan 21 09:37:50 2022] GET /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901 => generated 1723 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 21 09:37:51.235770 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-b2f8f427-c760-43b9-bdfa-b516c64972bb tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:37:51.236730 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-b2f8f427-c760-43b9-bdfa-b516c64972bb tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] [instance: c2cf8bdb-ca1e-40cb-b09a-58e8e59a213f] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:37:51.250381 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-b2f8f427-c760-43b9-bdfa-b516c64972bb tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:51.254811 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-b2f8f427-c760-43b9-bdfa-b516c64972bb tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:51.254811 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-b2f8f427-c760-43b9-bdfa-b516c64972bb tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:51.254811 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-b2f8f427-c760-43b9-bdfa-b516c64972bb tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:51.440431 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-b2f8f427-c760-43b9-bdfa-b516c64972bb tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7233857fe3a341b78e6449904cd935bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1d230932114019a989885b46cb9283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:37:51.450989 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-b2f8f427-c760-43b9-bdfa-b516c64972bb tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] 10.222.0.45 "GET /compute/v2.1/servers/c2cf8bdb-ca1e-40cb-b09a-58e8e59a213f" status: 200 len: 1314 microversion: 2.1 time: 0.219017 Jan 21 09:37:51.451703 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-8267746c-bdf5-43bb-a017-20b5c7777dbc tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:37:51.452387 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-8267746c-bdf5-43bb-a017-20b5c7777dbc tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] [instance: 4e67b25e-7e65-4975-bafa-fceafcd53647] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:37:51.463179 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 193/372] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:37:51 2022] GET /compute/v2.1/servers/c2cf8bdb-ca1e-40cb-b09a-58e8e59a213f => generated 1314 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:37:51.464691 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-8267746c-bdf5-43bb-a017-20b5c7777dbc tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:51.465190 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-8267746c-bdf5-43bb-a017-20b5c7777dbc tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:51.466946 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-8267746c-bdf5-43bb-a017-20b5c7777dbc tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:51.467797 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-8267746c-bdf5-43bb-a017-20b5c7777dbc tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:51.805807 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-8267746c-bdf5-43bb-a017-20b5c7777dbc tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db87258db1424ce7a8399fdd05efe3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89d1b21ad8471a8a9a82adac2594c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:37:51.818075 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-8267746c-bdf5-43bb-a017-20b5c7777dbc tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] 10.222.0.45 "GET /compute/v2.1/servers/4e67b25e-7e65-4975-bafa-fceafcd53647" status: 200 len: 1520 microversion: 2.1 time: 0.370084 Jan 21 09:37:51.824134 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 180/373] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:37:51 2022] GET /compute/v2.1/servers/4e67b25e-7e65-4975-bafa-fceafcd53647 => generated 1520 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 09:37:51.893405 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-66062872-73cc-40ac-953a-474bb36a9de6 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:37:51.894057 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-66062872-73cc-40ac-953a-474bb36a9de6 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] [instance: 59ad64a5-af93-44ef-8031-fd2f2d18a901] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:37:51.913015 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-66062872-73cc-40ac-953a-474bb36a9de6 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:51.913491 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-66062872-73cc-40ac-953a-474bb36a9de6 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:51.914294 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-66062872-73cc-40ac-953a-474bb36a9de6 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:51.914726 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-66062872-73cc-40ac-953a-474bb36a9de6 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:52.225271 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-66062872-73cc-40ac-953a-474bb36a9de6 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:37:52.248146 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-66062872-73cc-40ac-953a-474bb36a9de6 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:37:52.248146 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-66062872-73cc-40ac-953a-474bb36a9de6 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:37:52.248146 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-66062872-73cc-40ac-953a-474bb36a9de6 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "GET /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901" status: 200 len: 1723 microversion: 2.20 time: 0.357466 Jan 21 09:37:52.258858 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 194/374] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jan 21 09:37:51 2022] GET /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901 => generated 1723 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 21 09:37:52.470816 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-5115c6ed-c8d1-4e78-9785-65e6b313e3d7 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:37:52.471861 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-5115c6ed-c8d1-4e78-9785-65e6b313e3d7 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] [instance: c2cf8bdb-ca1e-40cb-b09a-58e8e59a213f] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:37:52.484624 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-5115c6ed-c8d1-4e78-9785-65e6b313e3d7 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:52.485285 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-5115c6ed-c8d1-4e78-9785-65e6b313e3d7 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:52.486039 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-5115c6ed-c8d1-4e78-9785-65e6b313e3d7 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:52.486518 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-5115c6ed-c8d1-4e78-9785-65e6b313e3d7 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:52.837040 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-9666fd80-c85b-4c63-8fa5-27a2fff195b5 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:37:52.838076 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-9666fd80-c85b-4c63-8fa5-27a2fff195b5 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] [instance: 4e67b25e-7e65-4975-bafa-fceafcd53647] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:37:52.856589 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-9666fd80-c85b-4c63-8fa5-27a2fff195b5 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:52.857199 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-9666fd80-c85b-4c63-8fa5-27a2fff195b5 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:52.860270 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-9666fd80-c85b-4c63-8fa5-27a2fff195b5 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:52.860719 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-9666fd80-c85b-4c63-8fa5-27a2fff195b5 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:52.913856 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-5115c6ed-c8d1-4e78-9785-65e6b313e3d7 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7233857fe3a341b78e6449904cd935bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1d230932114019a989885b46cb9283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:37:52.924518 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-5115c6ed-c8d1-4e78-9785-65e6b313e3d7 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] 10.222.0.45 "GET /compute/v2.1/servers/c2cf8bdb-ca1e-40cb-b09a-58e8e59a213f" status: 200 len: 1314 microversion: 2.1 time: 0.454833 Jan 21 09:37:52.925161 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 181/375] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:37:52 2022] GET /compute/v2.1/servers/c2cf8bdb-ca1e-40cb-b09a-58e8e59a213f => generated 1314 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:37:53.265056 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-e4d20350-4c23-4d1f-bcdf-f9cfe3d2c891 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:37:53.265677 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-e4d20350-4c23-4d1f-bcdf-f9cfe3d2c891 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] [instance: 59ad64a5-af93-44ef-8031-fd2f2d18a901] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:37:53.272986 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-e4d20350-4c23-4d1f-bcdf-f9cfe3d2c891 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:53.277814 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-e4d20350-4c23-4d1f-bcdf-f9cfe3d2c891 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:53.279440 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-e4d20350-4c23-4d1f-bcdf-f9cfe3d2c891 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:53.280073 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-e4d20350-4c23-4d1f-bcdf-f9cfe3d2c891 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:53.309275 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-9666fd80-c85b-4c63-8fa5-27a2fff195b5 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db87258db1424ce7a8399fdd05efe3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89d1b21ad8471a8a9a82adac2594c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:37:53.351152 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-9666fd80-c85b-4c63-8fa5-27a2fff195b5 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] 10.222.0.45 "GET /compute/v2.1/servers/4e67b25e-7e65-4975-bafa-fceafcd53647" status: 200 len: 1520 microversion: 2.1 time: 0.512343 Jan 21 09:37:53.354099 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 195/376] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:37:52 2022] GET /compute/v2.1/servers/4e67b25e-7e65-4975-bafa-fceafcd53647 => generated 1520 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:37:53.634518 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-e4d20350-4c23-4d1f-bcdf-f9cfe3d2c891 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:37:53.652833 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-e4d20350-4c23-4d1f-bcdf-f9cfe3d2c891 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:37:53.655310 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-e4d20350-4c23-4d1f-bcdf-f9cfe3d2c891 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:37:53.656625 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-e4d20350-4c23-4d1f-bcdf-f9cfe3d2c891 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "GET /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901" status: 200 len: 1723 microversion: 2.20 time: 0.395267 Jan 21 09:37:53.679119 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 182/377] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jan 21 09:37:53 2022] GET /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901 => generated 1723 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 21 09:37:53.942790 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-797058ad-24fe-4cf3-ba34-60907668ae26 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:37:53.945861 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-797058ad-24fe-4cf3-ba34-60907668ae26 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] [instance: c2cf8bdb-ca1e-40cb-b09a-58e8e59a213f] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:37:53.963127 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-797058ad-24fe-4cf3-ba34-60907668ae26 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:53.966976 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-797058ad-24fe-4cf3-ba34-60907668ae26 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:53.969053 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-797058ad-24fe-4cf3-ba34-60907668ae26 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:53.972680 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-797058ad-24fe-4cf3-ba34-60907668ae26 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:54.347537 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-797058ad-24fe-4cf3-ba34-60907668ae26 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7233857fe3a341b78e6449904cd935bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1d230932114019a989885b46cb9283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:37:54.355711 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-797058ad-24fe-4cf3-ba34-60907668ae26 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] 10.222.0.45 "GET /compute/v2.1/servers/c2cf8bdb-ca1e-40cb-b09a-58e8e59a213f" status: 200 len: 1314 microversion: 2.1 time: 0.417570 Jan 21 09:37:54.362456 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 196/378] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:37:53 2022] GET /compute/v2.1/servers/c2cf8bdb-ca1e-40cb-b09a-58e8e59a213f => generated 1314 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:37:54.376854 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-318f27db-ebf9-4e7b-ad0b-db21b2e1ae46 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:37:54.377847 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-318f27db-ebf9-4e7b-ad0b-db21b2e1ae46 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] [instance: 4e67b25e-7e65-4975-bafa-fceafcd53647] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:37:54.391725 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-318f27db-ebf9-4e7b-ad0b-db21b2e1ae46 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:54.392361 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-318f27db-ebf9-4e7b-ad0b-db21b2e1ae46 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:54.393374 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-318f27db-ebf9-4e7b-ad0b-db21b2e1ae46 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:54.397354 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-318f27db-ebf9-4e7b-ad0b-db21b2e1ae46 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:54.593003 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-318f27db-ebf9-4e7b-ad0b-db21b2e1ae46 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db87258db1424ce7a8399fdd05efe3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89d1b21ad8471a8a9a82adac2594c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:37:54.604308 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-318f27db-ebf9-4e7b-ad0b-db21b2e1ae46 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] 10.222.0.45 "GET /compute/v2.1/servers/4e67b25e-7e65-4975-bafa-fceafcd53647" status: 200 len: 1500 microversion: 2.1 time: 0.229231 Jan 21 09:37:54.604308 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 183/379] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:37:54 2022] GET /compute/v2.1/servers/4e67b25e-7e65-4975-bafa-fceafcd53647 => generated 1500 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:37:54.622938 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-2b055a70-f4b7-4c1a-9935-0d45bc0db462 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cec33547-6b63-475f-9530-ec9254cf7a02"}} {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:37:54.625117 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-2b055a70-f4b7-4c1a-9935-0d45bc0db462 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] [instance: 4e67b25e-7e65-4975-bafa-fceafcd53647] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:37:54.636439 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-2b055a70-f4b7-4c1a-9935-0d45bc0db462 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:54.637245 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-2b055a70-f4b7-4c1a-9935-0d45bc0db462 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:54.638642 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-2b055a70-f4b7-4c1a-9935-0d45bc0db462 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:54.639303 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-2b055a70-f4b7-4c1a-9935-0d45bc0db462 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:54.683897 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-68136cf4-b650-4515-956c-1cce1c68d375 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:37:54.684637 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-68136cf4-b650-4515-956c-1cce1c68d375 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] [instance: 59ad64a5-af93-44ef-8031-fd2f2d18a901] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:37:54.700663 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-68136cf4-b650-4515-956c-1cce1c68d375 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:54.701042 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-68136cf4-b650-4515-956c-1cce1c68d375 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:54.703738 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-68136cf4-b650-4515-956c-1cce1c68d375 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:54.703858 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-68136cf4-b650-4515-956c-1cce1c68d375 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:54.723087 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.wsgi [None req-2b055a70-f4b7-4c1a-9935-0d45bc0db462 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] HTTP exception thrown: Cannot 'attach_volume' instance 4e67b25e-7e65-4975-bafa-fceafcd53647 while it is in vm_state rescued Jan 21 09:37:54.723886 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-2b055a70-f4b7-4c1a-9935-0d45bc0db462 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Returning 409 to user: Cannot 'attach_volume' instance 4e67b25e-7e65-4975-bafa-fceafcd53647 while it is in vm_state rescued {{(pid=123387) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 21 09:37:54.726242 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-2b055a70-f4b7-4c1a-9935-0d45bc0db462 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] 10.222.0.45 "POST /compute/v2.1/servers/4e67b25e-7e65-4975-bafa-fceafcd53647/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.108510 Jan 21 09:37:54.733754 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 197/380] 10.222.0.45 () {60 vars in 1322 bytes} [Fri Jan 21 09:37:54 2022] POST /compute/v2.1/servers/4e67b25e-7e65-4975-bafa-fceafcd53647/os-volume_attachments => generated 152 bytes in 116 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jan 21 09:37:54.746862 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-90bff25e-15aa-4671-8c36-7f80f8df227b tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:37:54.747678 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-90bff25e-15aa-4671-8c36-7f80f8df227b tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] [instance: 4e67b25e-7e65-4975-bafa-fceafcd53647] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:37:54.766818 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-90bff25e-15aa-4671-8c36-7f80f8df227b tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:54.767507 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-90bff25e-15aa-4671-8c36-7f80f8df227b tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:54.768509 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-90bff25e-15aa-4671-8c36-7f80f8df227b tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:54.770035 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-90bff25e-15aa-4671-8c36-7f80f8df227b tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:54.946009 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-68136cf4-b650-4515-956c-1cce1c68d375 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:37:54.957751 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-68136cf4-b650-4515-956c-1cce1c68d375 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:37:54.959592 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-68136cf4-b650-4515-956c-1cce1c68d375 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:37:54.961025 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-68136cf4-b650-4515-956c-1cce1c68d375 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "GET /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901" status: 200 len: 1723 microversion: 2.20 time: 0.288698 Jan 21 09:37:54.962077 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 184/381] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jan 21 09:37:54 2022] GET /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901 => generated 1723 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 21 09:37:55.040598 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-90bff25e-15aa-4671-8c36-7f80f8df227b tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] 10.222.0.45 "POST /compute/v2.1/servers/4e67b25e-7e65-4975-bafa-fceafcd53647/action" status: 202 len: 0 microversion: 2.1 time: 0.304463 Jan 21 09:37:55.041973 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 198/382] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Jan 21 09:37:54 2022] POST /compute/v2.1/servers/4e67b25e-7e65-4975-bafa-fceafcd53647/action => generated 0 bytes in 308 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 21 09:37:55.052019 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-d2874351-9058-4bc1-9a4a-3201ffb81314 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:37:55.052627 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-d2874351-9058-4bc1-9a4a-3201ffb81314 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] [instance: 4e67b25e-7e65-4975-bafa-fceafcd53647] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:37:55.063937 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-d2874351-9058-4bc1-9a4a-3201ffb81314 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:55.064233 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-d2874351-9058-4bc1-9a4a-3201ffb81314 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:55.065250 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-d2874351-9058-4bc1-9a4a-3201ffb81314 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:55.065851 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-d2874351-9058-4bc1-9a4a-3201ffb81314 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:55.270701 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-d2874351-9058-4bc1-9a4a-3201ffb81314 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db87258db1424ce7a8399fdd05efe3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89d1b21ad8471a8a9a82adac2594c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:37:55.283231 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-d2874351-9058-4bc1-9a4a-3201ffb81314 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] 10.222.0.45 "GET /compute/v2.1/servers/4e67b25e-7e65-4975-bafa-fceafcd53647" status: 200 len: 1508 microversion: 2.1 time: 0.236712 Jan 21 09:37:55.286421 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 185/383] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:37:55 2022] GET /compute/v2.1/servers/4e67b25e-7e65-4975-bafa-fceafcd53647 => generated 1508 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:37:55.387113 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-a2a1efc7-2005-45ec-9925-0a18ac710e66 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:37:55.388096 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-a2a1efc7-2005-45ec-9925-0a18ac710e66 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] [instance: c2cf8bdb-ca1e-40cb-b09a-58e8e59a213f] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:37:55.395317 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-a2a1efc7-2005-45ec-9925-0a18ac710e66 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:55.395767 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-a2a1efc7-2005-45ec-9925-0a18ac710e66 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:55.396966 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-a2a1efc7-2005-45ec-9925-0a18ac710e66 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:55.397433 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-a2a1efc7-2005-45ec-9925-0a18ac710e66 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:55.630972 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-a2a1efc7-2005-45ec-9925-0a18ac710e66 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7233857fe3a341b78e6449904cd935bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1d230932114019a989885b46cb9283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:37:55.649069 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-a2a1efc7-2005-45ec-9925-0a18ac710e66 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] 10.222.0.45 "GET /compute/v2.1/servers/c2cf8bdb-ca1e-40cb-b09a-58e8e59a213f" status: 200 len: 1499 microversion: 2.1 time: 0.265065 Jan 21 09:37:55.649714 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 199/384] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:37:55 2022] GET /compute/v2.1/servers/c2cf8bdb-ca1e-40cb-b09a-58e8e59a213f => generated 1499 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:37:55.982471 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-e7a609fb-923b-48ba-94ab-76ecca402b32 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:37:55.983766 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-e7a609fb-923b-48ba-94ab-76ecca402b32 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] [instance: 59ad64a5-af93-44ef-8031-fd2f2d18a901] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:37:56.017574 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-e7a609fb-923b-48ba-94ab-76ecca402b32 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:56.020843 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-e7a609fb-923b-48ba-94ab-76ecca402b32 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:56.021739 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-e7a609fb-923b-48ba-94ab-76ecca402b32 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:56.022181 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-e7a609fb-923b-48ba-94ab-76ecca402b32 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:56.230777 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-e7a609fb-923b-48ba-94ab-76ecca402b32 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:37:56.239906 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-e7a609fb-923b-48ba-94ab-76ecca402b32 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:37:56.241446 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-e7a609fb-923b-48ba-94ab-76ecca402b32 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:37:56.242657 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-e7a609fb-923b-48ba-94ab-76ecca402b32 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "GET /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901" status: 200 len: 1723 microversion: 2.20 time: 0.267256 Jan 21 09:37:56.243212 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 186/385] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jan 21 09:37:55 2022] GET /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901 => generated 1723 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 21 09:37:56.308914 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-101b580d-2983-4d97-9197-38bb17733ea3 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:37:56.309763 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-101b580d-2983-4d97-9197-38bb17733ea3 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] [instance: 4e67b25e-7e65-4975-bafa-fceafcd53647] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:37:56.316774 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-101b580d-2983-4d97-9197-38bb17733ea3 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:56.317378 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-101b580d-2983-4d97-9197-38bb17733ea3 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:56.318183 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-101b580d-2983-4d97-9197-38bb17733ea3 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:56.318609 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-101b580d-2983-4d97-9197-38bb17733ea3 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:56.489020 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-101b580d-2983-4d97-9197-38bb17733ea3 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db87258db1424ce7a8399fdd05efe3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89d1b21ad8471a8a9a82adac2594c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:37:56.489020 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-101b580d-2983-4d97-9197-38bb17733ea3 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] 10.222.0.45 "GET /compute/v2.1/servers/4e67b25e-7e65-4975-bafa-fceafcd53647" status: 200 len: 1508 microversion: 2.1 time: 0.169787 Jan 21 09:37:56.489020 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 200/386] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:37:56 2022] GET /compute/v2.1/servers/4e67b25e-7e65-4975-bafa-fceafcd53647 => generated 1508 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:37:57.261037 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-e28bc9d3-6d7b-431f-bb5f-1134da82456c tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:37:57.261682 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-e28bc9d3-6d7b-431f-bb5f-1134da82456c tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] [instance: 59ad64a5-af93-44ef-8031-fd2f2d18a901] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:37:57.271131 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-e28bc9d3-6d7b-431f-bb5f-1134da82456c tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:57.271841 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-e28bc9d3-6d7b-431f-bb5f-1134da82456c tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:57.272827 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-e28bc9d3-6d7b-431f-bb5f-1134da82456c tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:57.273302 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-e28bc9d3-6d7b-431f-bb5f-1134da82456c tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:57.433575 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-e28bc9d3-6d7b-431f-bb5f-1134da82456c tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:37:57.442532 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-e28bc9d3-6d7b-431f-bb5f-1134da82456c tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:37:57.445609 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-e28bc9d3-6d7b-431f-bb5f-1134da82456c tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:37:57.446817 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-e28bc9d3-6d7b-431f-bb5f-1134da82456c tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "GET /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901" status: 200 len: 1723 microversion: 2.20 time: 0.189676 Jan 21 09:37:57.447375 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 187/387] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jan 21 09:37:57 2022] GET /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901 => generated 1723 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 21 09:37:57.506657 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-8015baa9-cf97-46d8-954b-1692c2ccab33 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:37:57.507917 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-8015baa9-cf97-46d8-954b-1692c2ccab33 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] [instance: 4e67b25e-7e65-4975-bafa-fceafcd53647] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:37:57.514992 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-8015baa9-cf97-46d8-954b-1692c2ccab33 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:57.515690 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-8015baa9-cf97-46d8-954b-1692c2ccab33 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:57.516649 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-8015baa9-cf97-46d8-954b-1692c2ccab33 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:57.517267 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-8015baa9-cf97-46d8-954b-1692c2ccab33 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:57.692870 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-8015baa9-cf97-46d8-954b-1692c2ccab33 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db87258db1424ce7a8399fdd05efe3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89d1b21ad8471a8a9a82adac2594c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:37:57.708947 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-8015baa9-cf97-46d8-954b-1692c2ccab33 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] 10.222.0.45 "GET /compute/v2.1/servers/4e67b25e-7e65-4975-bafa-fceafcd53647" status: 200 len: 1508 microversion: 2.1 time: 0.202172 Jan 21 09:37:57.710079 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 201/388] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:37:57 2022] GET /compute/v2.1/servers/4e67b25e-7e65-4975-bafa-fceafcd53647 => generated 1508 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:37:58.473491 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-836280f2-acc0-425a-acb7-5cb9e6f8cc7e tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:37:58.474931 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-836280f2-acc0-425a-acb7-5cb9e6f8cc7e tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] [instance: 59ad64a5-af93-44ef-8031-fd2f2d18a901] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:37:58.498420 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-836280f2-acc0-425a-acb7-5cb9e6f8cc7e tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:58.499072 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-836280f2-acc0-425a-acb7-5cb9e6f8cc7e tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:58.501445 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-836280f2-acc0-425a-acb7-5cb9e6f8cc7e tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:58.501990 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-836280f2-acc0-425a-acb7-5cb9e6f8cc7e tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:58.565340 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-b9d0a81b-6d5d-4448-a4ea-24e2b8c5529d tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:37:58.567071 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-b9d0a81b-6d5d-4448-a4ea-24e2b8c5529d tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] [instance: c2cf8bdb-ca1e-40cb-b09a-58e8e59a213f] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:37:58.574034 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-b9d0a81b-6d5d-4448-a4ea-24e2b8c5529d tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:58.574815 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-b9d0a81b-6d5d-4448-a4ea-24e2b8c5529d tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:58.575766 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-b9d0a81b-6d5d-4448-a4ea-24e2b8c5529d tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:58.576343 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-b9d0a81b-6d5d-4448-a4ea-24e2b8c5529d tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:58.643750 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-b9d0a81b-6d5d-4448-a4ea-24e2b8c5529d tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] [instance: c2cf8bdb-ca1e-40cb-b09a-58e8e59a213f] Going to try to terminate instance {{(pid=123387) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 21 09:37:58.714600 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-836280f2-acc0-425a-acb7-5cb9e6f8cc7e tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:37:58.727857 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-836280f2-acc0-425a-acb7-5cb9e6f8cc7e tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:37:58.729827 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-836280f2-acc0-425a-acb7-5cb9e6f8cc7e tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:37:58.731123 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-836280f2-acc0-425a-acb7-5cb9e6f8cc7e tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "GET /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901" status: 200 len: 1723 microversion: 2.20 time: 0.267092 Jan 21 09:37:58.743241 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 188/389] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jan 21 09:37:58 2022] GET /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901 => generated 1723 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 21 09:37:58.743241 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-97e36a6b-dac6-4a23-97f0-d50f9cc907ce tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:37:58.743241 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-97e36a6b-dac6-4a23-97f0-d50f9cc907ce tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] [instance: 4e67b25e-7e65-4975-bafa-fceafcd53647] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:37:58.745904 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-97e36a6b-dac6-4a23-97f0-d50f9cc907ce tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:58.746475 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-97e36a6b-dac6-4a23-97f0-d50f9cc907ce tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:58.747344 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-97e36a6b-dac6-4a23-97f0-d50f9cc907ce tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:58.748033 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-97e36a6b-dac6-4a23-97f0-d50f9cc907ce tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:58.978972 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-b9d0a81b-6d5d-4448-a4ea-24e2b8c5529d tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] 10.222.0.45 "DELETE /compute/v2.1/servers/c2cf8bdb-ca1e-40cb-b09a-58e8e59a213f" status: 204 len: 0 microversion: 2.1 time: 0.416782 Jan 21 09:37:58.979745 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 202/390] 10.222.0.45 () {58 vars in 1238 bytes} [Fri Jan 21 09:37:58 2022] DELETE /compute/v2.1/servers/c2cf8bdb-ca1e-40cb-b09a-58e8e59a213f => generated 0 bytes in 419 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jan 21 09:37:58.984078 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-97e36a6b-dac6-4a23-97f0-d50f9cc907ce tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db87258db1424ce7a8399fdd05efe3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89d1b21ad8471a8a9a82adac2594c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:37:58.991570 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-281dab36-6697-4c43-ad08-0928fd934410 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:37:58.992573 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-281dab36-6697-4c43-ad08-0928fd934410 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] [instance: c2cf8bdb-ca1e-40cb-b09a-58e8e59a213f] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:37:58.993980 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-97e36a6b-dac6-4a23-97f0-d50f9cc907ce tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] 10.222.0.45 "GET /compute/v2.1/servers/4e67b25e-7e65-4975-bafa-fceafcd53647" status: 200 len: 1508 microversion: 2.1 time: 0.260633 Jan 21 09:37:59.009685 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 189/391] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:37:58 2022] GET /compute/v2.1/servers/4e67b25e-7e65-4975-bafa-fceafcd53647 => generated 1508 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:37:59.023756 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-281dab36-6697-4c43-ad08-0928fd934410 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:59.033272 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-281dab36-6697-4c43-ad08-0928fd934410 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:59.037270 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-281dab36-6697-4c43-ad08-0928fd934410 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:59.038193 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-281dab36-6697-4c43-ad08-0928fd934410 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:59.256683 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-281dab36-6697-4c43-ad08-0928fd934410 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7233857fe3a341b78e6449904cd935bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1d230932114019a989885b46cb9283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:37:59.265421 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-281dab36-6697-4c43-ad08-0928fd934410 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] 10.222.0.45 "GET /compute/v2.1/servers/c2cf8bdb-ca1e-40cb-b09a-58e8e59a213f" status: 200 len: 1505 microversion: 2.1 time: 0.281166 Jan 21 09:37:59.273638 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 203/392] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:37:58 2022] GET /compute/v2.1/servers/c2cf8bdb-ca1e-40cb-b09a-58e8e59a213f => generated 1505 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 09:37:59.768125 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-14ae5980-b7eb-47c5-a4fd-35c699656a94 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:37:59.768125 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-14ae5980-b7eb-47c5-a4fd-35c699656a94 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] [instance: 59ad64a5-af93-44ef-8031-fd2f2d18a901] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:37:59.768125 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-14ae5980-b7eb-47c5-a4fd-35c699656a94 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:59.768125 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-14ae5980-b7eb-47c5-a4fd-35c699656a94 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:59.768850 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-14ae5980-b7eb-47c5-a4fd-35c699656a94 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:37:59.768850 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-14ae5980-b7eb-47c5-a4fd-35c699656a94 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:37:59.964092 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-14ae5980-b7eb-47c5-a4fd-35c699656a94 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:37:59.974126 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-14ae5980-b7eb-47c5-a4fd-35c699656a94 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:37:59.975878 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-14ae5980-b7eb-47c5-a4fd-35c699656a94 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:37:59.977323 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-14ae5980-b7eb-47c5-a4fd-35c699656a94 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "GET /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901" status: 200 len: 1723 microversion: 2.20 time: 0.230592 Jan 21 09:37:59.977896 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 190/393] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jan 21 09:37:59 2022] GET /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901 => generated 1723 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 21 09:38:00.013099 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-6f6acf92-a59f-45fb-87bb-205073408ab6 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:38:00.045622 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-6f6acf92-a59f-45fb-87bb-205073408ab6 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] [instance: 4e67b25e-7e65-4975-bafa-fceafcd53647] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:38:00.045622 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-6f6acf92-a59f-45fb-87bb-205073408ab6 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:00.045622 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-6f6acf92-a59f-45fb-87bb-205073408ab6 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:00.045622 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-6f6acf92-a59f-45fb-87bb-205073408ab6 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:00.046063 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-6f6acf92-a59f-45fb-87bb-205073408ab6 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:00.166790 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-6f6acf92-a59f-45fb-87bb-205073408ab6 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db87258db1424ce7a8399fdd05efe3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89d1b21ad8471a8a9a82adac2594c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:38:00.179661 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-6f6acf92-a59f-45fb-87bb-205073408ab6 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] 10.222.0.45 "GET /compute/v2.1/servers/4e67b25e-7e65-4975-bafa-fceafcd53647" status: 200 len: 1508 microversion: 2.1 time: 0.170128 Jan 21 09:38:00.180236 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 204/394] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:38:00 2022] GET /compute/v2.1/servers/4e67b25e-7e65-4975-bafa-fceafcd53647 => generated 1508 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:38:00.283756 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-d025510d-a16b-4d3a-ac00-2e79c723028f tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:38:00.284366 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-d025510d-a16b-4d3a-ac00-2e79c723028f tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] [instance: c2cf8bdb-ca1e-40cb-b09a-58e8e59a213f] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:38:00.291384 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-d025510d-a16b-4d3a-ac00-2e79c723028f tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:00.291835 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-d025510d-a16b-4d3a-ac00-2e79c723028f tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:00.292621 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-d025510d-a16b-4d3a-ac00-2e79c723028f tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:00.293055 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-d025510d-a16b-4d3a-ac00-2e79c723028f tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:00.432464 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-d025510d-a16b-4d3a-ac00-2e79c723028f tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7233857fe3a341b78e6449904cd935bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1d230932114019a989885b46cb9283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:38:00.441439 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-d025510d-a16b-4d3a-ac00-2e79c723028f tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] 10.222.0.45 "GET /compute/v2.1/servers/c2cf8bdb-ca1e-40cb-b09a-58e8e59a213f" status: 200 len: 1505 microversion: 2.1 time: 0.160567 Jan 21 09:38:00.451877 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 191/395] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:38:00 2022] GET /compute/v2.1/servers/c2cf8bdb-ca1e-40cb-b09a-58e8e59a213f => generated 1505 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:38:00.761691 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-7ac82625-2535-45c5-9aac-bcb98cbe2b8e tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7866bcb4-f5c0-4304-a41b-1c8bb3634d8c"}} {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:38:00.762924 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-7ac82625-2535-45c5-9aac-bcb98cbe2b8e tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] [instance: ad91ae0f-410b-479b-82f5-c0e18d325a8b] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:38:00.774742 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-7ac82625-2535-45c5-9aac-bcb98cbe2b8e tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:00.775196 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-7ac82625-2535-45c5-9aac-bcb98cbe2b8e tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:00.775994 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-7ac82625-2535-45c5-9aac-bcb98cbe2b8e tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:00.776459 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-7ac82625-2535-45c5-9aac-bcb98cbe2b8e tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:00.897076 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.wsgi [None req-7ac82625-2535-45c5-9aac-bcb98cbe2b8e tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] HTTP exception thrown: Invalid volume: volume 7866bcb4-f5c0-4304-a41b-1c8bb3634d8c is already attached to instances: ad91ae0f-410b-479b-82f5-c0e18d325a8b Jan 21 09:38:00.897706 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-7ac82625-2535-45c5-9aac-bcb98cbe2b8e tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Returning 400 to user: Invalid volume: volume 7866bcb4-f5c0-4304-a41b-1c8bb3634d8c is already attached to instances: ad91ae0f-410b-479b-82f5-c0e18d325a8b {{(pid=123387) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 21 09:38:00.898732 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-7ac82625-2535-45c5-9aac-bcb98cbe2b8e tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] 10.222.0.45 "POST /compute/v2.1/servers/ad91ae0f-410b-479b-82f5-c0e18d325a8b/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.141394 Jan 21 09:38:00.899298 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 205/396] 10.222.0.45 () {60 vars in 1322 bytes} [Fri Jan 21 09:38:00 2022] POST /compute/v2.1/servers/ad91ae0f-410b-479b-82f5-c0e18d325a8b/os-volume_attachments => generated 174 bytes in 143 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jan 21 09:38:00.962826 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-204a3332-afe6-4e0c-aef1-0b981303df09 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:38:00.963978 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-204a3332-afe6-4e0c-aef1-0b981303df09 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] [instance: ad91ae0f-410b-479b-82f5-c0e18d325a8b] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:38:00.973491 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-204a3332-afe6-4e0c-aef1-0b981303df09 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:00.974376 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-204a3332-afe6-4e0c-aef1-0b981303df09 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:00.975302 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-204a3332-afe6-4e0c-aef1-0b981303df09 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:00.975749 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-204a3332-afe6-4e0c-aef1-0b981303df09 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:00.997615 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-28707e1a-8c05-4075-ba71-a24f4b7f4763 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:38:00.999041 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-28707e1a-8c05-4075-ba71-a24f4b7f4763 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] [instance: 59ad64a5-af93-44ef-8031-fd2f2d18a901] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:38:01.008982 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-28707e1a-8c05-4075-ba71-a24f4b7f4763 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:01.009460 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-28707e1a-8c05-4075-ba71-a24f4b7f4763 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:01.010248 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-28707e1a-8c05-4075-ba71-a24f4b7f4763 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:01.010715 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-28707e1a-8c05-4075-ba71-a24f4b7f4763 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:01.194885 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.objects.instance [None req-204a3332-afe6-4e0c-aef1-0b981303df09 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lazy-loading 'services' on Instance uuid ad91ae0f-410b-479b-82f5-c0e18d325a8b {{(pid=123386) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 21 09:38:01.250295 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-28707e1a-8c05-4075-ba71-a24f4b7f4763 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:38:01.260469 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-28707e1a-8c05-4075-ba71-a24f4b7f4763 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:38:01.262316 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-28707e1a-8c05-4075-ba71-a24f4b7f4763 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:38:01.263814 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-28707e1a-8c05-4075-ba71-a24f4b7f4763 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "GET /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901" status: 200 len: 1723 microversion: 2.20 time: 0.269974 Jan 21 09:38:01.264986 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 206/397] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jan 21 09:38:00 2022] GET /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901 => generated 1723 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 21 09:38:01.271668 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-3749edd9-ec82-422b-acf1-135d903ba528 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:38:01.273274 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-3749edd9-ec82-422b-acf1-135d903ba528 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] [instance: 4e67b25e-7e65-4975-bafa-fceafcd53647] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:38:01.296328 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-3749edd9-ec82-422b-acf1-135d903ba528 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:01.296768 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-3749edd9-ec82-422b-acf1-135d903ba528 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:01.297654 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-3749edd9-ec82-422b-acf1-135d903ba528 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:01.298007 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-3749edd9-ec82-422b-acf1-135d903ba528 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:01.489541 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-204a3332-afe6-4e0c-aef1-0b981303df09 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] 10.222.0.45 "DELETE /compute/v2.1/servers/ad91ae0f-410b-479b-82f5-c0e18d325a8b/os-volume_attachments/7866bcb4-f5c0-4304-a41b-1c8bb3634d8c" status: 202 len: 0 microversion: 2.1 time: 0.528237 Jan 21 09:38:01.491082 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 192/398] 10.222.0.45 () {58 vars in 1415 bytes} [Fri Jan 21 09:38:00 2022] DELETE /compute/v2.1/servers/ad91ae0f-410b-479b-82f5-c0e18d325a8b/os-volume_attachments/7866bcb4-f5c0-4304-a41b-1c8bb3634d8c => generated 0 bytes in 533 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 21 09:38:01.498528 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-29c931ab-5e6a-48d3-b013-6fb964f9cca4 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:38:01.499607 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-29c931ab-5e6a-48d3-b013-6fb964f9cca4 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] [instance: c2cf8bdb-ca1e-40cb-b09a-58e8e59a213f] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:38:01.509654 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-29c931ab-5e6a-48d3-b013-6fb964f9cca4 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:01.510440 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-29c931ab-5e6a-48d3-b013-6fb964f9cca4 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:01.511584 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-29c931ab-5e6a-48d3-b013-6fb964f9cca4 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:01.512227 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-29c931ab-5e6a-48d3-b013-6fb964f9cca4 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:01.971124 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-3749edd9-ec82-422b-acf1-135d903ba528 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db87258db1424ce7a8399fdd05efe3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89d1b21ad8471a8a9a82adac2594c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:38:01.982757 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-3749edd9-ec82-422b-acf1-135d903ba528 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] 10.222.0.45 "GET /compute/v2.1/servers/4e67b25e-7e65-4975-bafa-fceafcd53647" status: 200 len: 1508 microversion: 2.1 time: 0.715568 Jan 21 09:38:01.983657 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 207/399] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:38:01 2022] GET /compute/v2.1/servers/4e67b25e-7e65-4975-bafa-fceafcd53647 => generated 1508 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:38:01.996267 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-333bce08-5fd5-479c-997a-8ff3114b9466 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:38:01.997678 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-333bce08-5fd5-479c-997a-8ff3114b9466 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] [instance: ad91ae0f-410b-479b-82f5-c0e18d325a8b] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:38:02.009574 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-333bce08-5fd5-479c-997a-8ff3114b9466 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:02.010307 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-333bce08-5fd5-479c-997a-8ff3114b9466 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:02.011483 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-333bce08-5fd5-479c-997a-8ff3114b9466 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:02.012445 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-333bce08-5fd5-479c-997a-8ff3114b9466 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:02.014238 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-29c931ab-5e6a-48d3-b013-6fb964f9cca4 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7233857fe3a341b78e6449904cd935bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1d230932114019a989885b46cb9283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:38:02.040264 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-29c931ab-5e6a-48d3-b013-6fb964f9cca4 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] 10.222.0.45 "GET /compute/v2.1/servers/c2cf8bdb-ca1e-40cb-b09a-58e8e59a213f" status: 200 len: 1505 microversion: 2.1 time: 0.547564 Jan 21 09:38:02.056847 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-333bce08-5fd5-479c-997a-8ff3114b9466 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] 10.222.0.45 "GET /compute/v2.1/servers/ad91ae0f-410b-479b-82f5-c0e18d325a8b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.072041 Jan 21 09:38:02.058125 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 208/400] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Jan 21 09:38:01 2022] GET /compute/v2.1/servers/ad91ae0f-410b-479b-82f5-c0e18d325a8b/os-volume_attachments => generated 197 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 09:38:02.058532 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 193/401] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:38:01 2022] GET /compute/v2.1/servers/c2cf8bdb-ca1e-40cb-b09a-58e8e59a213f => generated 1505 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:38:02.284226 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-f3563451-ae8d-47a5-9565-b8d418212a0a tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:38:02.286262 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-f3563451-ae8d-47a5-9565-b8d418212a0a tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] [instance: 59ad64a5-af93-44ef-8031-fd2f2d18a901] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:38:02.297019 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-f3563451-ae8d-47a5-9565-b8d418212a0a tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:02.297784 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-f3563451-ae8d-47a5-9565-b8d418212a0a tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:02.298825 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-f3563451-ae8d-47a5-9565-b8d418212a0a tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:02.299452 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-f3563451-ae8d-47a5-9565-b8d418212a0a tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:02.577057 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-f3563451-ae8d-47a5-9565-b8d418212a0a tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:38:02.586746 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-f3563451-ae8d-47a5-9565-b8d418212a0a tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:38:02.590581 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-f3563451-ae8d-47a5-9565-b8d418212a0a tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:38:02.595373 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-f3563451-ae8d-47a5-9565-b8d418212a0a tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "GET /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901" status: 200 len: 1723 microversion: 2.20 time: 0.316099 Jan 21 09:38:02.596829 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 209/402] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jan 21 09:38:02 2022] GET /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901 => generated 1723 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 21 09:38:02.798044 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [req-8b8c5aad-a0b6-4895-b9d1-acedb624fc73 req-f105ee8a-1ac8-4741-b7da-250be79ec871 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2cf8bdb-ca1e-40cb-b09a-58e8e59a213f", "name": "network-vif-deleted", "tag": "6bb3a0f1-e345-49d2-b142-75f408fac434"}]} {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:38:02.800186 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 21 09:38:02.800186 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: warnings.warn(msg) Jan 21 09:38:02.808496 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [req-8b8c5aad-a0b6-4895-b9d1-acedb624fc73 req-f105ee8a-1ac8-4741-b7da-250be79ec871 service nova] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:02.809262 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [req-8b8c5aad-a0b6-4895-b9d1-acedb624fc73 req-f105ee8a-1ac8-4741-b7da-250be79ec871 service nova] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:02.822331 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.compute.server_external_events [req-8b8c5aad-a0b6-4895-b9d1-acedb624fc73 req-f105ee8a-1ac8-4741-b7da-250be79ec871 service nova] Creating event network-vif-deleted:6bb3a0f1-e345-49d2-b142-75f408fac434 for instance c2cf8bdb-ca1e-40cb-b09a-58e8e59a213f on hv-cinder-80403 Jan 21 09:38:02.830451 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [req-8b8c5aad-a0b6-4895-b9d1-acedb624fc73 req-f105ee8a-1ac8-4741-b7da-250be79ec871 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033820 Jan 21 09:38:02.831908 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 194/403] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Jan 21 09:38:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 09:38:02.938021 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-f700cb7c-8336-4d9d-b5b6-079871014b83 tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:38:02.938524 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-f700cb7c-8336-4d9d-b5b6-079871014b83 tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] [instance: deb54068-874d-4b55-ab9c-777c53b1d707] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:38:02.945609 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-f700cb7c-8336-4d9d-b5b6-079871014b83 tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:02.946303 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-f700cb7c-8336-4d9d-b5b6-079871014b83 tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:02.948084 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-f700cb7c-8336-4d9d-b5b6-079871014b83 tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:02.948084 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-f700cb7c-8336-4d9d-b5b6-079871014b83 tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:03.007891 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-4e66d0e7-c8f7-4d02-b47b-2d1ad48d7548 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:38:03.008589 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-4e66d0e7-c8f7-4d02-b47b-2d1ad48d7548 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] [instance: 4e67b25e-7e65-4975-bafa-fceafcd53647] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:38:03.018440 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-4e66d0e7-c8f7-4d02-b47b-2d1ad48d7548 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:03.019670 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-4e66d0e7-c8f7-4d02-b47b-2d1ad48d7548 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:03.020221 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-4e66d0e7-c8f7-4d02-b47b-2d1ad48d7548 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:03.020654 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-4e66d0e7-c8f7-4d02-b47b-2d1ad48d7548 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:03.106963 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.objects.instance [None req-f700cb7c-8336-4d9d-b5b6-079871014b83 tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Lazy-loading 'services' on Instance uuid deb54068-874d-4b55-ab9c-777c53b1d707 {{(pid=123387) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 21 09:38:03.230324 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-4e66d0e7-c8f7-4d02-b47b-2d1ad48d7548 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db87258db1424ce7a8399fdd05efe3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89d1b21ad8471a8a9a82adac2594c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:38:03.240068 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-4e66d0e7-c8f7-4d02-b47b-2d1ad48d7548 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] 10.222.0.45 "GET /compute/v2.1/servers/4e67b25e-7e65-4975-bafa-fceafcd53647" status: 200 len: 1514 microversion: 2.1 time: 0.237062 Jan 21 09:38:03.249940 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 195/404] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:38:03 2022] GET /compute/v2.1/servers/4e67b25e-7e65-4975-bafa-fceafcd53647 => generated 1514 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:38:03.258137 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-234a8016-b6b6-42e0-9a9a-b3f1acbc7def tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:38:03.260534 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-234a8016-b6b6-42e0-9a9a-b3f1acbc7def tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] [instance: c2cf8bdb-ca1e-40cb-b09a-58e8e59a213f] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:38:03.267608 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-234a8016-b6b6-42e0-9a9a-b3f1acbc7def tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:03.268062 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-234a8016-b6b6-42e0-9a9a-b3f1acbc7def tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:03.269784 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-234a8016-b6b6-42e0-9a9a-b3f1acbc7def tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:03.270527 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-234a8016-b6b6-42e0-9a9a-b3f1acbc7def tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:03.307842 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-234a8016-b6b6-42e0-9a9a-b3f1acbc7def tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:03.308300 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-234a8016-b6b6-42e0-9a9a-b3f1acbc7def tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:03.308756 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.objects.instance [None req-234a8016-b6b6-42e0-9a9a-b3f1acbc7def tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Lazy-loading 'fault' on Instance uuid c2cf8bdb-ca1e-40cb-b09a-58e8e59a213f {{(pid=123386) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 21 09:38:03.362383 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-234a8016-b6b6-42e0-9a9a-b3f1acbc7def tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7233857fe3a341b78e6449904cd935bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1d230932114019a989885b46cb9283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:38:03.372068 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-234a8016-b6b6-42e0-9a9a-b3f1acbc7def tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] 10.222.0.45 "GET /compute/v2.1/servers/c2cf8bdb-ca1e-40cb-b09a-58e8e59a213f" status: 200 len: 1304 microversion: 2.1 time: 0.121088 Jan 21 09:38:03.373081 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 196/405] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:38:03 2022] GET /compute/v2.1/servers/c2cf8bdb-ca1e-40cb-b09a-58e8e59a213f => generated 1304 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:38:03.397480 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-ef535531-710c-4c6f-9ed7-0f27265cdc0a tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:38:03.399077 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-ef535531-710c-4c6f-9ed7-0f27265cdc0a tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] [instance: ad91ae0f-410b-479b-82f5-c0e18d325a8b] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:38:03.406182 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-ef535531-710c-4c6f-9ed7-0f27265cdc0a tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:03.407453 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-ef535531-710c-4c6f-9ed7-0f27265cdc0a tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:03.409086 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-ef535531-710c-4c6f-9ed7-0f27265cdc0a tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:03.410146 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-ef535531-710c-4c6f-9ed7-0f27265cdc0a tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:03.437983 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-f700cb7c-8336-4d9d-b5b6-079871014b83 tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] 10.222.0.45 "DELETE /compute/v2.1/servers/deb54068-874d-4b55-ab9c-777c53b1d707/os-volume_attachments/54dc78a6-469f-4ee8-85a0-a227bb8f2c7f" status: 202 len: 0 microversion: 2.1 time: 0.506745 Jan 21 09:38:03.444583 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 210/406] 10.222.0.45 () {58 vars in 1415 bytes} [Fri Jan 21 09:38:02 2022] DELETE /compute/v2.1/servers/deb54068-874d-4b55-ab9c-777c53b1d707/os-volume_attachments/54dc78a6-469f-4ee8-85a0-a227bb8f2c7f => generated 0 bytes in 514 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 21 09:38:03.447051 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-ef535531-710c-4c6f-9ed7-0f27265cdc0a tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] 10.222.0.45 "GET /compute/v2.1/servers/ad91ae0f-410b-479b-82f5-c0e18d325a8b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.068413 Jan 21 09:38:03.447832 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 197/407] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Jan 21 09:38:03 2022] GET /compute/v2.1/servers/ad91ae0f-410b-479b-82f5-c0e18d325a8b/os-volume_attachments => generated 25 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 21 09:38:03.628053 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-b7c11068-b5cc-41c4-9c7a-dd102ce7be48 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:38:03.635171 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-b7c11068-b5cc-41c4-9c7a-dd102ce7be48 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] [instance: 59ad64a5-af93-44ef-8031-fd2f2d18a901] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:38:03.656226 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-b7c11068-b5cc-41c4-9c7a-dd102ce7be48 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:03.656691 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-b7c11068-b5cc-41c4-9c7a-dd102ce7be48 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:03.658271 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-b7c11068-b5cc-41c4-9c7a-dd102ce7be48 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:03.658500 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-b7c11068-b5cc-41c4-9c7a-dd102ce7be48 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:03.705799 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-c95a2707-4ee1-49bf-9e69-e39a52e42bc5 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2050522318", "imageRef": "813e53ee-82e7-4a13-9f63-a8be7b1089f1", "flavorRef": "452", "networks": [{"uuid": "6d3bfab5-614b-42ce-87b9-03bdb3f3c1da"}]}} {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:38:03.835182 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.network.neutron [None req-c95a2707-4ee1-49bf-9e69-e39a52e42bc5 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] validate_networks() for [('6d3bfab5-614b-42ce-87b9-03bdb3f3c1da', None, None, None, None, None)] {{(pid=123386) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 21 09:38:04.015860 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-b7c11068-b5cc-41c4-9c7a-dd102ce7be48 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:38:04.026147 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-b7c11068-b5cc-41c4-9c7a-dd102ce7be48 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:38:04.029887 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-b7c11068-b5cc-41c4-9c7a-dd102ce7be48 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:38:04.034718 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-b7c11068-b5cc-41c4-9c7a-dd102ce7be48 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "GET /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901" status: 200 len: 1723 microversion: 2.20 time: 0.414201 Jan 21 09:38:04.045196 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 211/408] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jan 21 09:38:03 2022] GET /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901 => generated 1723 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 21 09:38:04.391460 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-6cba5b95-23b2-48e4-ab9e-4019aea11890 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:38:04.392528 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-6cba5b95-23b2-48e4-ab9e-4019aea11890 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] [instance: c2cf8bdb-ca1e-40cb-b09a-58e8e59a213f] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:38:04.414272 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-6cba5b95-23b2-48e4-ab9e-4019aea11890 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:04.414749 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-6cba5b95-23b2-48e4-ab9e-4019aea11890 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:04.415582 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-6cba5b95-23b2-48e4-ab9e-4019aea11890 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:04.416196 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-6cba5b95-23b2-48e4-ab9e-4019aea11890 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:04.465668 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-6cba5b95-23b2-48e4-ab9e-4019aea11890 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:04.467108 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-6cba5b95-23b2-48e4-ab9e-4019aea11890 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:04.468822 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.objects.instance [None req-6cba5b95-23b2-48e4-ab9e-4019aea11890 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Lazy-loading 'fault' on Instance uuid c2cf8bdb-ca1e-40cb-b09a-58e8e59a213f {{(pid=123387) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 21 09:38:04.574425 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-6cba5b95-23b2-48e4-ab9e-4019aea11890 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7233857fe3a341b78e6449904cd935bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1d230932114019a989885b46cb9283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:38:04.588937 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-6cba5b95-23b2-48e4-ab9e-4019aea11890 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] 10.222.0.45 "GET /compute/v2.1/servers/c2cf8bdb-ca1e-40cb-b09a-58e8e59a213f" status: 200 len: 1304 microversion: 2.1 time: 0.201622 Jan 21 09:38:04.590172 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 212/409] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:38:04 2022] GET /compute/v2.1/servers/c2cf8bdb-ca1e-40cb-b09a-58e8e59a213f => generated 1304 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:38:04.665020 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.virt.hardware [None req-c95a2707-4ee1-49bf-9e69-e39a52e42bc5 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Flavor limits 0:0:0 {{(pid=123386) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 21 09:38:04.665573 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.virt.hardware [None req-c95a2707-4ee1-49bf-9e69-e39a52e42bc5 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Image limits 0:0:0 {{(pid=123386) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 21 09:38:04.665924 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.virt.hardware [None req-c95a2707-4ee1-49bf-9e69-e39a52e42bc5 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Flavor pref 0:0:0 {{(pid=123386) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 21 09:38:04.666446 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.virt.hardware [None req-c95a2707-4ee1-49bf-9e69-e39a52e42bc5 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Image pref 0:0:0 {{(pid=123386) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 21 09:38:04.666705 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.virt.hardware [None req-c95a2707-4ee1-49bf-9e69-e39a52e42bc5 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123386) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 21 09:38:04.678164 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-c95a2707-4ee1-49bf-9e69-e39a52e42bc5 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:04.678603 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-c95a2707-4ee1-49bf-9e69-e39a52e42bc5 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:04.679586 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-c95a2707-4ee1-49bf-9e69-e39a52e42bc5 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:04.680017 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-c95a2707-4ee1-49bf-9e69-e39a52e42bc5 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:04.697474 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.quota [None req-c95a2707-4ee1-49bf-9e69-e39a52e42bc5 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Getting quotas for project e3390729231b409e9a83376b428c1a7f. Resources: {'cores', 'instances', 'ram'} {{(pid=123386) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 21 09:38:04.704814 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.quota [None req-c95a2707-4ee1-49bf-9e69-e39a52e42bc5 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Getting quotas for user fc7b2c14d9444d65ab7a874e749671bb and project e3390729231b409e9a83376b428c1a7f. Resources: {'cores', 'instances', 'ram'} {{(pid=123386) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 21 09:38:04.724277 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-c95a2707-4ee1-49bf-9e69-e39a52e42bc5 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Going to run 1 instances... {{(pid=123386) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 21 09:38:04.724277 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-c95a2707-4ee1-49bf-9e69-e39a52e42bc5 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] [instance: 0f393a36-e048-4228-a48c-9ed725c3e71c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='813e53ee-82e7-4a13-9f63-a8be7b1089f1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123386) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 21 09:38:05.055216 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-9b881f12-a965-44d6-b50d-cc822f12fcaa tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:38:05.055821 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-9b881f12-a965-44d6-b50d-cc822f12fcaa tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] [instance: 59ad64a5-af93-44ef-8031-fd2f2d18a901] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:38:05.061710 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-9b881f12-a965-44d6-b50d-cc822f12fcaa tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:05.062154 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-9b881f12-a965-44d6-b50d-cc822f12fcaa tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:05.062940 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-9b881f12-a965-44d6-b50d-cc822f12fcaa tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:05.063374 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-9b881f12-a965-44d6-b50d-cc822f12fcaa tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:05.194907 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-c95a2707-4ee1-49bf-9e69-e39a52e42bc5 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.493529 Jan 21 09:38:05.198914 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 198/410] 10.222.0.45 () {60 vars in 1146 bytes} [Fri Jan 21 09:38:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 1498 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jan 21 09:38:05.202423 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-9b881f12-a965-44d6-b50d-cc822f12fcaa tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:38:05.212191 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-9b881f12-a965-44d6-b50d-cc822f12fcaa tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:38:05.213634 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-9b881f12-a965-44d6-b50d-cc822f12fcaa tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:38:05.214918 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-9b881f12-a965-44d6-b50d-cc822f12fcaa tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "GET /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901" status: 200 len: 1723 microversion: 2.20 time: 0.163360 Jan 21 09:38:05.215516 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 213/411] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jan 21 09:38:05 2022] GET /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901 => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 21 09:38:05.226807 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-d2c6a5c6-cd1a-4c34-b0d8-c3401d2f4fa9 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:38:05.227529 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-d2c6a5c6-cd1a-4c34-b0d8-c3401d2f4fa9 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] [instance: 0f393a36-e048-4228-a48c-9ed725c3e71c] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:38:05.356767 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-d2c6a5c6-cd1a-4c34-b0d8-c3401d2f4fa9 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7b2c14d9444d65ab7a874e749671bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3390729231b409e9a83376b428c1a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:38:05.366733 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-d2c6a5c6-cd1a-4c34-b0d8-c3401d2f4fa9 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] 10.222.0.45 "GET /compute/v2.1/servers/0f393a36-e048-4228-a48c-9ed725c3e71c" status: 200 len: 1218 microversion: 2.1 time: 0.164031 Jan 21 09:38:05.377732 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 199/412] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:38:05 2022] GET /compute/v2.1/servers/0f393a36-e048-4228-a48c-9ed725c3e71c => generated 1218 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:38:05.614814 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-70d6cdf4-3248-4e52-bc49-96e973504697 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:38:05.616176 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-70d6cdf4-3248-4e52-bc49-96e973504697 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] [instance: c2cf8bdb-ca1e-40cb-b09a-58e8e59a213f] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:38:05.622850 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-70d6cdf4-3248-4e52-bc49-96e973504697 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:05.623297 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-70d6cdf4-3248-4e52-bc49-96e973504697 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:05.624094 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-70d6cdf4-3248-4e52-bc49-96e973504697 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:05.624523 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-70d6cdf4-3248-4e52-bc49-96e973504697 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:05.642551 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.wsgi [None req-70d6cdf4-3248-4e52-bc49-96e973504697 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] HTTP exception thrown: Instance c2cf8bdb-ca1e-40cb-b09a-58e8e59a213f could not be found. Jan 21 09:38:05.642912 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-70d6cdf4-3248-4e52-bc49-96e973504697 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Returning 404 to user: Instance c2cf8bdb-ca1e-40cb-b09a-58e8e59a213f could not be found. {{(pid=123387) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 21 09:38:05.644364 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-70d6cdf4-3248-4e52-bc49-96e973504697 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] 10.222.0.45 "GET /compute/v2.1/servers/c2cf8bdb-ca1e-40cb-b09a-58e8e59a213f" status: 404 len: 111 microversion: 2.1 time: 0.033224 Jan 21 09:38:05.645262 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 214/413] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:38:05 2022] GET /compute/v2.1/servers/c2cf8bdb-ca1e-40cb-b09a-58e8e59a213f => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 21 09:38:05.717037 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-c57cab00-9b4d-4b38-9aa8-9ce4693a6ed4 tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:38:05.720327 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-c57cab00-9b4d-4b38-9aa8-9ce4693a6ed4 tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] [instance: deb54068-874d-4b55-ab9c-777c53b1d707] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:38:05.735008 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-c57cab00-9b4d-4b38-9aa8-9ce4693a6ed4 tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:05.735455 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-c57cab00-9b4d-4b38-9aa8-9ce4693a6ed4 tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:05.736398 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-c57cab00-9b4d-4b38-9aa8-9ce4693a6ed4 tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:05.736922 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-c57cab00-9b4d-4b38-9aa8-9ce4693a6ed4 tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:05.792981 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-c57cab00-9b4d-4b38-9aa8-9ce4693a6ed4 tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] [instance: deb54068-874d-4b55-ab9c-777c53b1d707] Going to try to terminate instance {{(pid=123386) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 21 09:38:05.823202 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-d732cfa2-d59e-4859-be46-01d737cad81a tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-58069605", "imageRef": "813e53ee-82e7-4a13-9f63-a8be7b1089f1", "flavorRef": "452", "networks": [{"uuid": "12c1a4df-23d6-4c4b-b623-e53eca6cd97e"}]}} {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:38:05.875098 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.network.neutron [None req-d732cfa2-d59e-4859-be46-01d737cad81a tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] validate_networks() for [('12c1a4df-23d6-4c4b-b623-e53eca6cd97e', None, None, None, None, None)] {{(pid=123387) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 21 09:38:06.254461 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.virt.hardware [None req-d732cfa2-d59e-4859-be46-01d737cad81a tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Flavor limits 0:0:0 {{(pid=123387) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 21 09:38:06.255478 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.virt.hardware [None req-d732cfa2-d59e-4859-be46-01d737cad81a tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Image limits 0:0:0 {{(pid=123387) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 21 09:38:06.255952 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.virt.hardware [None req-d732cfa2-d59e-4859-be46-01d737cad81a tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Flavor pref 0:0:0 {{(pid=123387) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 21 09:38:06.256354 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.virt.hardware [None req-d732cfa2-d59e-4859-be46-01d737cad81a tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Image pref 0:0:0 {{(pid=123387) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 21 09:38:06.256758 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.virt.hardware [None req-d732cfa2-d59e-4859-be46-01d737cad81a tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123387) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 21 09:38:06.265871 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-d732cfa2-d59e-4859-be46-01d737cad81a tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:06.266307 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-d732cfa2-d59e-4859-be46-01d737cad81a tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:06.268690 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-d732cfa2-d59e-4859-be46-01d737cad81a tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:06.268690 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-d732cfa2-d59e-4859-be46-01d737cad81a tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:06.284421 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.quota [None req-d732cfa2-d59e-4859-be46-01d737cad81a tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Getting quotas for project 6e1d230932114019a989885b46cb9283. Resources: {'cores', 'instances', 'ram'} {{(pid=123387) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 21 09:38:06.288932 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.quota [None req-d732cfa2-d59e-4859-be46-01d737cad81a tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Getting quotas for user 7233857fe3a341b78e6449904cd935bf and project 6e1d230932114019a989885b46cb9283. Resources: {'cores', 'instances', 'ram'} {{(pid=123387) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 21 09:38:06.305317 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-d732cfa2-d59e-4859-be46-01d737cad81a tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Going to run 1 instances... {{(pid=123387) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 21 09:38:06.307653 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-d732cfa2-d59e-4859-be46-01d737cad81a tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] [instance: a4e4d869-a178-4acd-8305-895d478f77ce] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='813e53ee-82e7-4a13-9f63-a8be7b1089f1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123387) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 21 09:38:06.362988 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-c57cab00-9b4d-4b38-9aa8-9ce4693a6ed4 tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] 10.222.0.45 "DELETE /compute/v2.1/servers/deb54068-874d-4b55-ab9c-777c53b1d707" status: 204 len: 0 microversion: 2.1 time: 0.651427 Jan 21 09:38:06.368538 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 200/414] 10.222.0.45 () {58 vars in 1238 bytes} [Fri Jan 21 09:38:05 2022] DELETE /compute/v2.1/servers/deb54068-874d-4b55-ab9c-777c53b1d707 => generated 0 bytes in 659 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 21 09:38:06.379035 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-be2e269c-8f3e-4848-ab26-152631719d41 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:38:06.379438 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-be2e269c-8f3e-4848-ab26-152631719d41 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] [instance: 4e67b25e-7e65-4975-bafa-fceafcd53647] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:38:06.386149 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-be2e269c-8f3e-4848-ab26-152631719d41 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:06.386663 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-be2e269c-8f3e-4848-ab26-152631719d41 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:06.387451 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-be2e269c-8f3e-4848-ab26-152631719d41 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:06.387884 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-be2e269c-8f3e-4848-ab26-152631719d41 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:06.468787 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-d732cfa2-d59e-4859-be46-01d737cad81a tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.649958 Jan 21 09:38:06.469594 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 215/415] 10.222.0.45 () {60 vars in 1146 bytes} [Fri Jan 21 09:38:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 651 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jan 21 09:38:06.475660 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-f2615524-8252-45e4-9245-28766e8aa9f6 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:38:06.476268 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-f2615524-8252-45e4-9245-28766e8aa9f6 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] [instance: 59ad64a5-af93-44ef-8031-fd2f2d18a901] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:38:06.482681 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-f2615524-8252-45e4-9245-28766e8aa9f6 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:06.483221 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-f2615524-8252-45e4-9245-28766e8aa9f6 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:06.484090 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-f2615524-8252-45e4-9245-28766e8aa9f6 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:06.484883 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-f2615524-8252-45e4-9245-28766e8aa9f6 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:06.560816 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-be2e269c-8f3e-4848-ab26-152631719d41 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db87258db1424ce7a8399fdd05efe3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89d1b21ad8471a8a9a82adac2594c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:38:06.585447 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-be2e269c-8f3e-4848-ab26-152631719d41 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] 10.222.0.45 "GET /compute/v2.1/servers/4e67b25e-7e65-4975-bafa-fceafcd53647" status: 200 len: 1514 microversion: 2.1 time: 0.208210 Jan 21 09:38:06.586637 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 201/416] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:38:06 2022] GET /compute/v2.1/servers/4e67b25e-7e65-4975-bafa-fceafcd53647 => generated 1514 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:38:06.603154 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-c33864cf-e5fe-4115-889d-180654baa3be tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:38:06.604295 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-c33864cf-e5fe-4115-889d-180654baa3be tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] [instance: deb54068-874d-4b55-ab9c-777c53b1d707] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:38:06.614801 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-c33864cf-e5fe-4115-889d-180654baa3be tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:06.615274 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-c33864cf-e5fe-4115-889d-180654baa3be tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:06.616264 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-c33864cf-e5fe-4115-889d-180654baa3be tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:06.616907 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-c33864cf-e5fe-4115-889d-180654baa3be tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:06.683743 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-f2615524-8252-45e4-9245-28766e8aa9f6 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:38:06.695984 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-f2615524-8252-45e4-9245-28766e8aa9f6 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:38:06.697715 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-f2615524-8252-45e4-9245-28766e8aa9f6 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:38:06.698895 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-f2615524-8252-45e4-9245-28766e8aa9f6 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "GET /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901" status: 200 len: 1723 microversion: 2.20 time: 0.227988 Jan 21 09:38:06.711453 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 216/417] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jan 21 09:38:06 2022] GET /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901 => generated 1723 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 21 09:38:06.711453 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-f99ad606-8ad3-4926-99ef-e05ffb794f13 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:38:06.711973 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-f99ad606-8ad3-4926-99ef-e05ffb794f13 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] [instance: 0f393a36-e048-4228-a48c-9ed725c3e71c] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:38:06.717965 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-f99ad606-8ad3-4926-99ef-e05ffb794f13 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:06.718721 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-f99ad606-8ad3-4926-99ef-e05ffb794f13 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:06.719303 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-f99ad606-8ad3-4926-99ef-e05ffb794f13 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:06.719738 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-f99ad606-8ad3-4926-99ef-e05ffb794f13 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:06.804305 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-f99ad606-8ad3-4926-99ef-e05ffb794f13 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7b2c14d9444d65ab7a874e749671bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3390729231b409e9a83376b428c1a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:38:06.813621 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-f99ad606-8ad3-4926-99ef-e05ffb794f13 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] 10.222.0.45 "GET /compute/v2.1/servers/0f393a36-e048-4228-a48c-9ed725c3e71c" status: 200 len: 1222 microversion: 2.1 time: 0.106804 Jan 21 09:38:06.815182 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 217/418] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:38:06 2022] GET /compute/v2.1/servers/0f393a36-e048-4228-a48c-9ed725c3e71c => generated 1222 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:38:06.822208 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-5dbf2151-dde3-4454-bae6-6a3d03c07684 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Action: 'create', calling method: .version_select at 0x7fb6c2e82160>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-226234256"}} {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:38:06.822589 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-c33864cf-e5fe-4115-889d-180654baa3be tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498146f6a6814129b393e7084057bfd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db07feb3a43432999da539b6b85fb2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:38:06.830908 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-c33864cf-e5fe-4115-889d-180654baa3be tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] 10.222.0.45 "GET /compute/v2.1/servers/deb54068-874d-4b55-ab9c-777c53b1d707" status: 200 len: 1512 microversion: 2.1 time: 0.243046 Jan 21 09:38:06.836503 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.quota [None req-5dbf2151-dde3-4454-bae6-6a3d03c07684 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Getting quotas for project 10ed49573f464cc18794b94fd1c115ee. Resources: {'key_pairs'} {{(pid=123387) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 21 09:38:06.842054 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.quota [None req-5dbf2151-dde3-4454-bae6-6a3d03c07684 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Getting quotas for user 84a8838f167743678110ca0a9d5a2484 and project 10ed49573f464cc18794b94fd1c115ee. Resources: {'key_pairs'} {{(pid=123387) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 21 09:38:06.842266 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 202/419] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:38:06 2022] GET /compute/v2.1/servers/deb54068-874d-4b55-ab9c-777c53b1d707 => generated 1512 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:38:06.845995 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-26b2bc6c-f0da-46a9-a174-b5b48c9bc46d tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:38:06.846614 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-26b2bc6c-f0da-46a9-a174-b5b48c9bc46d tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] [instance: a4e4d869-a178-4acd-8305-895d478f77ce] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:38:06.916169 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-26b2bc6c-f0da-46a9-a174-b5b48c9bc46d tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7233857fe3a341b78e6449904cd935bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1d230932114019a989885b46cb9283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:38:06.923413 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-26b2bc6c-f0da-46a9-a174-b5b48c9bc46d tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] 10.222.0.45 "GET /compute/v2.1/servers/a4e4d869-a178-4acd-8305-895d478f77ce" status: 200 len: 1212 microversion: 2.1 time: 0.081124 Jan 21 09:38:06.933595 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 203/420] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:38:06 2022] GET /compute/v2.1/servers/a4e4d869-a178-4acd-8305-895d478f77ce => generated 1212 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:38:06.939877 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-1b857168-563f-47f4-a41a-177075c267c0 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b2470e40-0bf8-4f16-8413-bc535817e14d"}} {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:38:06.941968 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-1b857168-563f-47f4-a41a-177075c267c0 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] [instance: 4e67b25e-7e65-4975-bafa-fceafcd53647] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:38:06.950730 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-1b857168-563f-47f4-a41a-177075c267c0 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:06.951403 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-1b857168-563f-47f4-a41a-177075c267c0 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:06.952571 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-1b857168-563f-47f4-a41a-177075c267c0 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:06.953420 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-1b857168-563f-47f4-a41a-177075c267c0 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:07.139047 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.quota [None req-5dbf2151-dde3-4454-bae6-6a3d03c07684 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Getting quotas for project 10ed49573f464cc18794b94fd1c115ee. Resources: {'key_pairs'} {{(pid=123387) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 21 09:38:07.144560 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.quota [None req-5dbf2151-dde3-4454-bae6-6a3d03c07684 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Getting quotas for user 84a8838f167743678110ca0a9d5a2484 and project 10ed49573f464cc18794b94fd1c115ee. Resources: {'key_pairs'} {{(pid=123387) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 21 09:38:07.158697 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-5dbf2151-dde3-4454-bae6-6a3d03c07684 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 2317 microversion: 2.1 time: 0.341547 Jan 21 09:38:07.159290 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 218/421] 10.222.0.45 () {60 vars in 1157 bytes} [Fri Jan 21 09:38:06 2022] POST /compute/v2.1/os-keypairs => generated 2317 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:38:07.274313 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-f0d39d50-d636-44ab-a1ce-48d276ef6ca6 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-499434944", "imageRef": "81502110-3133-433a-ac9f-ae3f0e5a5cdc", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-226234256", "networks": [{"uuid": "e49a728a-90d2-4a07-8a83-d63652f9661a"}]}} {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:38:07.325640 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.network.neutron [None req-f0d39d50-d636-44ab-a1ce-48d276ef6ca6 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] validate_networks() for [('e49a728a-90d2-4a07-8a83-d63652f9661a', None, None, None, None, None)] {{(pid=123387) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 21 09:38:07.724572 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.virt.hardware [None req-f0d39d50-d636-44ab-a1ce-48d276ef6ca6 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Flavor limits 0:0:0 {{(pid=123387) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 21 09:38:07.725136 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.virt.hardware [None req-f0d39d50-d636-44ab-a1ce-48d276ef6ca6 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Image limits 0:0:0 {{(pid=123387) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 21 09:38:07.725485 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.virt.hardware [None req-f0d39d50-d636-44ab-a1ce-48d276ef6ca6 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Flavor pref 0:0:0 {{(pid=123387) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 21 09:38:07.725887 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.virt.hardware [None req-f0d39d50-d636-44ab-a1ce-48d276ef6ca6 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Image pref 0:0:0 {{(pid=123387) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 21 09:38:07.726399 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.virt.hardware [None req-f0d39d50-d636-44ab-a1ce-48d276ef6ca6 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123387) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 21 09:38:07.734921 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-f0d39d50-d636-44ab-a1ce-48d276ef6ca6 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:07.735485 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-f0d39d50-d636-44ab-a1ce-48d276ef6ca6 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:07.736290 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-f0d39d50-d636-44ab-a1ce-48d276ef6ca6 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:07.736983 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-f0d39d50-d636-44ab-a1ce-48d276ef6ca6 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:07.753605 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.quota [None req-f0d39d50-d636-44ab-a1ce-48d276ef6ca6 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Getting quotas for project 10ed49573f464cc18794b94fd1c115ee. Resources: {'cores', 'instances', 'ram'} {{(pid=123387) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 21 09:38:07.757309 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.quota [None req-f0d39d50-d636-44ab-a1ce-48d276ef6ca6 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Getting quotas for user 84a8838f167743678110ca0a9d5a2484 and project 10ed49573f464cc18794b94fd1c115ee. Resources: {'cores', 'instances', 'ram'} {{(pid=123387) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 21 09:38:07.768454 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-f0d39d50-d636-44ab-a1ce-48d276ef6ca6 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Going to run 1 instances... {{(pid=123387) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 21 09:38:07.771438 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-f0d39d50-d636-44ab-a1ce-48d276ef6ca6 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] [instance: 750f8ae5-b267-4b76-bb13-170071722932] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='81502110-3133-433a-ac9f-ae3f0e5a5cdc',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123387) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 21 09:38:07.825059 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-1b857168-563f-47f4-a41a-177075c267c0 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] 10.222.0.45 "POST /compute/v2.1/servers/4e67b25e-7e65-4975-bafa-fceafcd53647/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.889557 Jan 21 09:38:07.826008 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 204/422] 10.222.0.45 () {60 vars in 1322 bytes} [Fri Jan 21 09:38:06 2022] POST /compute/v2.1/servers/4e67b25e-7e65-4975-bafa-fceafcd53647/os-volume_attachments => generated 194 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 09:38:07.832286 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-c1f0abf2-8665-4217-896c-50e02cd24174 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:38:07.833015 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-c1f0abf2-8665-4217-896c-50e02cd24174 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] [instance: 59ad64a5-af93-44ef-8031-fd2f2d18a901] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:38:07.840104 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-c1f0abf2-8665-4217-896c-50e02cd24174 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:07.840548 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-c1f0abf2-8665-4217-896c-50e02cd24174 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:07.842934 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-c1f0abf2-8665-4217-896c-50e02cd24174 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:07.842934 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-c1f0abf2-8665-4217-896c-50e02cd24174 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:07.953401 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-f0d39d50-d636-44ab-a1ce-48d276ef6ca6 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.682766 Jan 21 09:38:07.955835 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 219/423] 10.222.0.45 () {60 vars in 1146 bytes} [Fri Jan 21 09:38:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 686 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jan 21 09:38:07.964822 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-3437340e-1b48-47c8-aba7-ece4295a50dd tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:38:07.965736 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-3437340e-1b48-47c8-aba7-ece4295a50dd tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] [instance: 0f393a36-e048-4228-a48c-9ed725c3e71c] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:38:07.975038 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-3437340e-1b48-47c8-aba7-ece4295a50dd tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:07.995890 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-3437340e-1b48-47c8-aba7-ece4295a50dd tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:07.995890 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-3437340e-1b48-47c8-aba7-ece4295a50dd tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:07.995890 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-3437340e-1b48-47c8-aba7-ece4295a50dd tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:08.142909 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-3437340e-1b48-47c8-aba7-ece4295a50dd tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7b2c14d9444d65ab7a874e749671bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3390729231b409e9a83376b428c1a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:38:08.160081 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-c1f0abf2-8665-4217-896c-50e02cd24174 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:38:08.160442 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-3437340e-1b48-47c8-aba7-ece4295a50dd tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] 10.222.0.45 "GET /compute/v2.1/servers/0f393a36-e048-4228-a48c-9ed725c3e71c" status: 200 len: 1278 microversion: 2.1 time: 0.195194 Jan 21 09:38:08.160442 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 220/424] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:38:07 2022] GET /compute/v2.1/servers/0f393a36-e048-4228-a48c-9ed725c3e71c => generated 1278 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:38:08.173105 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-c1f0abf2-8665-4217-896c-50e02cd24174 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:38:08.176154 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-09807f51-c790-4c3a-b9b6-9212701e2724 tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:38:08.176747 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-09807f51-c790-4c3a-b9b6-9212701e2724 tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] [instance: deb54068-874d-4b55-ab9c-777c53b1d707] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:38:08.178352 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-c1f0abf2-8665-4217-896c-50e02cd24174 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:38:08.181212 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-c1f0abf2-8665-4217-896c-50e02cd24174 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "GET /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901" status: 200 len: 1723 microversion: 2.20 time: 0.354029 Jan 21 09:38:08.184624 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-09807f51-c790-4c3a-b9b6-9212701e2724 tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:08.185067 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-09807f51-c790-4c3a-b9b6-9212701e2724 tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:08.193220 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 205/425] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jan 21 09:38:07 2022] GET /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901 => generated 1723 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 21 09:38:08.193220 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-0b577421-6cea-4038-bbb4-d5e151bc33a2 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:38:08.193220 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-0b577421-6cea-4038-bbb4-d5e151bc33a2 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] [instance: a4e4d869-a178-4acd-8305-895d478f77ce] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:38:08.194528 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-09807f51-c790-4c3a-b9b6-9212701e2724 tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:08.194980 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-09807f51-c790-4c3a-b9b6-9212701e2724 tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:08.207596 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-0b577421-6cea-4038-bbb4-d5e151bc33a2 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:08.208139 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-0b577421-6cea-4038-bbb4-d5e151bc33a2 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:08.211126 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-0b577421-6cea-4038-bbb4-d5e151bc33a2 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:08.211574 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-0b577421-6cea-4038-bbb4-d5e151bc33a2 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:08.351283 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-0b577421-6cea-4038-bbb4-d5e151bc33a2 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7233857fe3a341b78e6449904cd935bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1d230932114019a989885b46cb9283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:38:08.359913 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-0b577421-6cea-4038-bbb4-d5e151bc33a2 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] 10.222.0.45 "GET /compute/v2.1/servers/a4e4d869-a178-4acd-8305-895d478f77ce" status: 200 len: 1208 microversion: 2.1 time: 0.172707 Jan 21 09:38:08.361527 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 206/426] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:38:08 2022] GET /compute/v2.1/servers/a4e4d869-a178-4acd-8305-895d478f77ce => generated 1208 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:38:08.367141 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-13286028-40c3-4033-bc20-6598d831e95c tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:38:08.367796 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-13286028-40c3-4033-bc20-6598d831e95c tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] [instance: 750f8ae5-b267-4b76-bb13-170071722932] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:38:08.466802 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-13286028-40c3-4033-bc20-6598d831e95c tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a8838f167743678110ca0a9d5a2484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10ed49573f464cc18794b94fd1c115ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:38:08.474529 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-13286028-40c3-4033-bc20-6598d831e95c tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] 10.222.0.45 "GET /compute/v2.1/servers/750f8ae5-b267-4b76-bb13-170071722932" status: 200 len: 1257 microversion: 2.1 time: 0.111739 Jan 21 09:38:08.475107 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 207/427] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:38:08 2022] GET /compute/v2.1/servers/750f8ae5-b267-4b76-bb13-170071722932 => generated 1257 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:38:08.610315 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-09807f51-c790-4c3a-b9b6-9212701e2724 tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498146f6a6814129b393e7084057bfd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db07feb3a43432999da539b6b85fb2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:38:08.618030 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-09807f51-c790-4c3a-b9b6-9212701e2724 tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] 10.222.0.45 "GET /compute/v2.1/servers/deb54068-874d-4b55-ab9c-777c53b1d707" status: 200 len: 1512 microversion: 2.1 time: 0.460451 Jan 21 09:38:08.618599 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 221/428] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:38:08 2022] GET /compute/v2.1/servers/deb54068-874d-4b55-ab9c-777c53b1d707 => generated 1512 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:38:09.172658 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-0cbecb0e-c65c-4f34-82cf-5670e0fa2797 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:38:09.173216 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-0cbecb0e-c65c-4f34-82cf-5670e0fa2797 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] [instance: 0f393a36-e048-4228-a48c-9ed725c3e71c] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:38:09.180283 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-0cbecb0e-c65c-4f34-82cf-5670e0fa2797 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:09.182985 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-0cbecb0e-c65c-4f34-82cf-5670e0fa2797 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:09.182985 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-0cbecb0e-c65c-4f34-82cf-5670e0fa2797 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:09.182985 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-0cbecb0e-c65c-4f34-82cf-5670e0fa2797 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:09.217018 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-25a717d7-ea2b-49cd-9922-91ba9275c5c6 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:38:09.219054 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-25a717d7-ea2b-49cd-9922-91ba9275c5c6 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] [instance: 59ad64a5-af93-44ef-8031-fd2f2d18a901] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:38:09.239065 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-25a717d7-ea2b-49cd-9922-91ba9275c5c6 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:09.239730 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-25a717d7-ea2b-49cd-9922-91ba9275c5c6 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:09.240522 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-25a717d7-ea2b-49cd-9922-91ba9275c5c6 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:09.240955 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-25a717d7-ea2b-49cd-9922-91ba9275c5c6 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:09.657668 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-0cbecb0e-c65c-4f34-82cf-5670e0fa2797 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7b2c14d9444d65ab7a874e749671bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3390729231b409e9a83376b428c1a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:38:09.675668 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-0cbecb0e-c65c-4f34-82cf-5670e0fa2797 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] 10.222.0.45 "GET /compute/v2.1/servers/0f393a36-e048-4228-a48c-9ed725c3e71c" status: 200 len: 1318 microversion: 2.1 time: 0.506181 Jan 21 09:38:09.689883 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 208/429] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:38:09 2022] GET /compute/v2.1/servers/0f393a36-e048-4228-a48c-9ed725c3e71c => generated 1318 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:38:09.703523 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-86c19dbc-0243-473d-9e54-ff4696b039f9 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:38:09.705287 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-86c19dbc-0243-473d-9e54-ff4696b039f9 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] [instance: a4e4d869-a178-4acd-8305-895d478f77ce] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:38:09.742349 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-25a717d7-ea2b-49cd-9922-91ba9275c5c6 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:38:09.746071 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-86c19dbc-0243-473d-9e54-ff4696b039f9 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:09.746872 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-86c19dbc-0243-473d-9e54-ff4696b039f9 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:09.749107 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-86c19dbc-0243-473d-9e54-ff4696b039f9 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:09.751903 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-86c19dbc-0243-473d-9e54-ff4696b039f9 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:09.757006 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-25a717d7-ea2b-49cd-9922-91ba9275c5c6 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:38:09.758559 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-25a717d7-ea2b-49cd-9922-91ba9275c5c6 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:38:09.759753 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-25a717d7-ea2b-49cd-9922-91ba9275c5c6 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "GET /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901" status: 200 len: 1744 microversion: 2.20 time: 0.550796 Jan 21 09:38:09.769807 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 222/430] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jan 21 09:38:09 2022] GET /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901 => generated 1744 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 21 09:38:09.783132 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-fb99c3d8-d396-40b5-b18a-98e94f46d239 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:38:09.783755 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-fb99c3d8-d396-40b5-b18a-98e94f46d239 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] [instance: 750f8ae5-b267-4b76-bb13-170071722932] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:38:09.800880 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-fb99c3d8-d396-40b5-b18a-98e94f46d239 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:09.801608 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-fb99c3d8-d396-40b5-b18a-98e94f46d239 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:09.802606 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-fb99c3d8-d396-40b5-b18a-98e94f46d239 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:09.803199 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-fb99c3d8-d396-40b5-b18a-98e94f46d239 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:10.239767 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-86c19dbc-0243-473d-9e54-ff4696b039f9 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7233857fe3a341b78e6449904cd935bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1d230932114019a989885b46cb9283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:38:10.248664 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-86c19dbc-0243-473d-9e54-ff4696b039f9 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] 10.222.0.45 "GET /compute/v2.1/servers/a4e4d869-a178-4acd-8305-895d478f77ce" status: 200 len: 1272 microversion: 2.1 time: 0.552668 Jan 21 09:38:10.251483 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 209/431] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:38:09 2022] GET /compute/v2.1/servers/a4e4d869-a178-4acd-8305-895d478f77ce => generated 1272 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:38:10.257408 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-bef8b830-1160-4bc4-87f5-625ba91977d1 tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:38:10.258347 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-bef8b830-1160-4bc4-87f5-625ba91977d1 tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] [instance: deb54068-874d-4b55-ab9c-777c53b1d707] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:38:10.273023 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-bef8b830-1160-4bc4-87f5-625ba91977d1 tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:10.275162 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-bef8b830-1160-4bc4-87f5-625ba91977d1 tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:10.276289 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-bef8b830-1160-4bc4-87f5-625ba91977d1 tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:10.277391 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-bef8b830-1160-4bc4-87f5-625ba91977d1 tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:10.279371 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-fb99c3d8-d396-40b5-b18a-98e94f46d239 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a8838f167743678110ca0a9d5a2484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10ed49573f464cc18794b94fd1c115ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:38:10.288273 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-fb99c3d8-d396-40b5-b18a-98e94f46d239 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] 10.222.0.45 "GET /compute/v2.1/servers/750f8ae5-b267-4b76-bb13-170071722932" status: 200 len: 1261 microversion: 2.1 time: 0.517134 Jan 21 09:38:10.298423 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 223/432] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:38:09 2022] GET /compute/v2.1/servers/750f8ae5-b267-4b76-bb13-170071722932 => generated 1261 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:38:10.694491 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-9b87b05f-805a-4ddf-b7bb-5eca3cee7841 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:38:10.697175 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-9b87b05f-805a-4ddf-b7bb-5eca3cee7841 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] [instance: 0f393a36-e048-4228-a48c-9ed725c3e71c] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:38:10.705008 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-9b87b05f-805a-4ddf-b7bb-5eca3cee7841 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:10.705500 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-9b87b05f-805a-4ddf-b7bb-5eca3cee7841 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:10.708366 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-9b87b05f-805a-4ddf-b7bb-5eca3cee7841 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:10.708840 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-9b87b05f-805a-4ddf-b7bb-5eca3cee7841 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:10.766164 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-bef8b830-1160-4bc4-87f5-625ba91977d1 tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498146f6a6814129b393e7084057bfd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db07feb3a43432999da539b6b85fb2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:38:10.777839 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-bef8b830-1160-4bc4-87f5-625ba91977d1 tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] 10.222.0.45 "GET /compute/v2.1/servers/deb54068-874d-4b55-ab9c-777c53b1d707" status: 200 len: 1512 microversion: 2.1 time: 0.522573 Jan 21 09:38:10.779642 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 210/433] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:38:10 2022] GET /compute/v2.1/servers/deb54068-874d-4b55-ab9c-777c53b1d707 => generated 1512 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:38:10.793698 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-14662c73-2b9d-43f4-a365-82960e9abef5 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:38:10.794512 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-14662c73-2b9d-43f4-a365-82960e9abef5 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] [instance: 59ad64a5-af93-44ef-8031-fd2f2d18a901] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:38:10.809329 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-14662c73-2b9d-43f4-a365-82960e9abef5 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:10.810158 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-14662c73-2b9d-43f4-a365-82960e9abef5 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:10.811175 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-14662c73-2b9d-43f4-a365-82960e9abef5 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:10.813230 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-14662c73-2b9d-43f4-a365-82960e9abef5 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:11.252776 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-9b87b05f-805a-4ddf-b7bb-5eca3cee7841 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7b2c14d9444d65ab7a874e749671bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3390729231b409e9a83376b428c1a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:38:11.255682 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-14662c73-2b9d-43f4-a365-82960e9abef5 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:38:11.264066 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-9b87b05f-805a-4ddf-b7bb-5eca3cee7841 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] 10.222.0.45 "GET /compute/v2.1/servers/0f393a36-e048-4228-a48c-9ed725c3e71c" status: 200 len: 1318 microversion: 2.1 time: 0.570736 Jan 21 09:38:11.264345 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-14662c73-2b9d-43f4-a365-82960e9abef5 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:38:11.264841 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 224/434] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:38:10 2022] GET /compute/v2.1/servers/0f393a36-e048-4228-a48c-9ed725c3e71c => generated 1318 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 09:38:11.265921 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-14662c73-2b9d-43f4-a365-82960e9abef5 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:38:11.267285 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-14662c73-2b9d-43f4-a365-82960e9abef5 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "GET /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901" status: 200 len: 1744 microversion: 2.20 time: 0.478425 Jan 21 09:38:11.268106 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 211/435] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jan 21 09:38:10 2022] GET /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901 => generated 1744 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 21 09:38:11.271553 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [req-624c5bfe-23bf-4716-8546-92e4b67eb26f req-6b65b2d0-81a3-4bc5-8258-6be9c4cfd730 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "deb54068-874d-4b55-ab9c-777c53b1d707", "name": "network-vif-deleted", "tag": "14aab43b-4ab3-4c41-bc46-826e868d0936"}]} {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:38:11.273187 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 21 09:38:11.273187 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: warnings.warn(msg) Jan 21 09:38:11.278543 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-cf6f8fd1-2844-43a8-a6fc-a394dea428d6 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:38:11.279311 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-cf6f8fd1-2844-43a8-a6fc-a394dea428d6 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] [instance: a4e4d869-a178-4acd-8305-895d478f77ce] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:38:11.284824 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [req-624c5bfe-23bf-4716-8546-92e4b67eb26f req-6b65b2d0-81a3-4bc5-8258-6be9c4cfd730 service nova] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:11.285488 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [req-624c5bfe-23bf-4716-8546-92e4b67eb26f req-6b65b2d0-81a3-4bc5-8258-6be9c4cfd730 service nova] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:11.288013 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-cf6f8fd1-2844-43a8-a6fc-a394dea428d6 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:11.288013 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-cf6f8fd1-2844-43a8-a6fc-a394dea428d6 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:11.288013 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-cf6f8fd1-2844-43a8-a6fc-a394dea428d6 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:11.288013 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-cf6f8fd1-2844-43a8-a6fc-a394dea428d6 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:11.298382 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.compute.server_external_events [req-624c5bfe-23bf-4716-8546-92e4b67eb26f req-6b65b2d0-81a3-4bc5-8258-6be9c4cfd730 service nova] Creating event network-vif-deleted:14aab43b-4ab3-4c41-bc46-826e868d0936 for instance deb54068-874d-4b55-ab9c-777c53b1d707 on hv-cinder-80403 Jan 21 09:38:11.304579 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [req-624c5bfe-23bf-4716-8546-92e4b67eb26f req-6b65b2d0-81a3-4bc5-8258-6be9c4cfd730 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037975 Jan 21 09:38:11.305392 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 225/436] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Jan 21 09:38:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 09:38:11.320365 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-8c77e4a4-0abf-4db1-9a12-3a846940b59e tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:38:11.322169 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-8c77e4a4-0abf-4db1-9a12-3a846940b59e tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] [instance: 750f8ae5-b267-4b76-bb13-170071722932] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:38:11.330843 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-8c77e4a4-0abf-4db1-9a12-3a846940b59e tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:11.331521 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-8c77e4a4-0abf-4db1-9a12-3a846940b59e tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:11.332708 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-8c77e4a4-0abf-4db1-9a12-3a846940b59e tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:11.333175 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-8c77e4a4-0abf-4db1-9a12-3a846940b59e tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:11.510001 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-8c77e4a4-0abf-4db1-9a12-3a846940b59e tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a8838f167743678110ca0a9d5a2484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10ed49573f464cc18794b94fd1c115ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:38:11.532191 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-8c77e4a4-0abf-4db1-9a12-3a846940b59e tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] 10.222.0.45 "GET /compute/v2.1/servers/750f8ae5-b267-4b76-bb13-170071722932" status: 200 len: 1317 microversion: 2.1 time: 0.214880 Jan 21 09:38:11.532991 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 226/437] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:38:11 2022] GET /compute/v2.1/servers/750f8ae5-b267-4b76-bb13-170071722932 => generated 1317 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 09:38:11.820010 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-cf6f8fd1-2844-43a8-a6fc-a394dea428d6 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7233857fe3a341b78e6449904cd935bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1d230932114019a989885b46cb9283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:38:11.821637 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-9df2394e-8d8f-4857-8ee3-78c767046a49 tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:38:11.822589 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-9df2394e-8d8f-4857-8ee3-78c767046a49 tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] [instance: deb54068-874d-4b55-ab9c-777c53b1d707] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:38:11.827595 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-cf6f8fd1-2844-43a8-a6fc-a394dea428d6 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] 10.222.0.45 "GET /compute/v2.1/servers/a4e4d869-a178-4acd-8305-895d478f77ce" status: 200 len: 1312 microversion: 2.1 time: 0.558356 Jan 21 09:38:11.829738 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-9df2394e-8d8f-4857-8ee3-78c767046a49 tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:11.830197 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-9df2394e-8d8f-4857-8ee3-78c767046a49 tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:11.830907 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 212/438] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:38:11 2022] GET /compute/v2.1/servers/a4e4d869-a178-4acd-8305-895d478f77ce => generated 1312 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:38:11.831017 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-9df2394e-8d8f-4857-8ee3-78c767046a49 tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:11.831468 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-9df2394e-8d8f-4857-8ee3-78c767046a49 tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:11.899818 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-9df2394e-8d8f-4857-8ee3-78c767046a49 tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:11.900708 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-9df2394e-8d8f-4857-8ee3-78c767046a49 tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:11.901409 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.objects.instance [None req-9df2394e-8d8f-4857-8ee3-78c767046a49 tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Lazy-loading 'fault' on Instance uuid deb54068-874d-4b55-ab9c-777c53b1d707 {{(pid=123387) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 21 09:38:11.995221 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-9df2394e-8d8f-4857-8ee3-78c767046a49 tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498146f6a6814129b393e7084057bfd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db07feb3a43432999da539b6b85fb2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:38:12.009130 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-9df2394e-8d8f-4857-8ee3-78c767046a49 tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] 10.222.0.45 "GET /compute/v2.1/servers/deb54068-874d-4b55-ab9c-777c53b1d707" status: 200 len: 1308 microversion: 2.1 time: 0.203288 Jan 21 09:38:12.010655 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 227/439] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:38:11 2022] GET /compute/v2.1/servers/deb54068-874d-4b55-ab9c-777c53b1d707 => generated 1308 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:38:12.283198 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-512baeb3-8c42-4e39-9cf5-c8ecdc8a3489 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:38:12.286364 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-e7faf451-b006-4f2f-ba0a-dacdc040d978 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:38:12.287043 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-e7faf451-b006-4f2f-ba0a-dacdc040d978 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] [instance: 59ad64a5-af93-44ef-8031-fd2f2d18a901] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:38:12.287379 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-512baeb3-8c42-4e39-9cf5-c8ecdc8a3489 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] [instance: 0f393a36-e048-4228-a48c-9ed725c3e71c] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:38:12.299014 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-512baeb3-8c42-4e39-9cf5-c8ecdc8a3489 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:12.304542 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-512baeb3-8c42-4e39-9cf5-c8ecdc8a3489 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:12.305017 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-e7faf451-b006-4f2f-ba0a-dacdc040d978 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:12.307956 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-512baeb3-8c42-4e39-9cf5-c8ecdc8a3489 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:12.308634 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-512baeb3-8c42-4e39-9cf5-c8ecdc8a3489 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:12.309982 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-e7faf451-b006-4f2f-ba0a-dacdc040d978 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:12.311304 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-e7faf451-b006-4f2f-ba0a-dacdc040d978 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:12.311975 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-e7faf451-b006-4f2f-ba0a-dacdc040d978 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:12.903564 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-e7faf451-b006-4f2f-ba0a-dacdc040d978 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:38:12.913029 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-512baeb3-8c42-4e39-9cf5-c8ecdc8a3489 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7b2c14d9444d65ab7a874e749671bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3390729231b409e9a83376b428c1a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:38:12.918172 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-e7faf451-b006-4f2f-ba0a-dacdc040d978 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:38:12.919695 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-e7faf451-b006-4f2f-ba0a-dacdc040d978 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:38:12.921324 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-e7faf451-b006-4f2f-ba0a-dacdc040d978 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "GET /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901" status: 200 len: 1744 microversion: 2.20 time: 0.639471 Jan 21 09:38:12.921887 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 228/440] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jan 21 09:38:12 2022] GET /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901 => generated 1744 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 21 09:38:12.930813 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-512baeb3-8c42-4e39-9cf5-c8ecdc8a3489 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] 10.222.0.45 "GET /compute/v2.1/servers/0f393a36-e048-4228-a48c-9ed725c3e71c" status: 200 len: 1318 microversion: 2.1 time: 0.652134 Jan 21 09:38:12.940067 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 213/441] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:38:12 2022] GET /compute/v2.1/servers/0f393a36-e048-4228-a48c-9ed725c3e71c => generated 1318 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:38:12.950908 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-2192f072-796a-4057-b732-c15c90455850 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:38:12.951281 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-4b7d992d-4737-41c9-b3c2-080be3406de0 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:38:12.951572 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-2192f072-796a-4057-b732-c15c90455850 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] [instance: a4e4d869-a178-4acd-8305-895d478f77ce] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:38:12.955187 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-4b7d992d-4737-41c9-b3c2-080be3406de0 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] [instance: 750f8ae5-b267-4b76-bb13-170071722932] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:38:12.989256 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-4b7d992d-4737-41c9-b3c2-080be3406de0 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:12.989694 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-4b7d992d-4737-41c9-b3c2-080be3406de0 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:12.991920 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-4b7d992d-4737-41c9-b3c2-080be3406de0 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:12.998610 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-2192f072-796a-4057-b732-c15c90455850 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:12.999358 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-2192f072-796a-4057-b732-c15c90455850 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:13.000602 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-2192f072-796a-4057-b732-c15c90455850 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:13.001251 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-2192f072-796a-4057-b732-c15c90455850 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:13.002241 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-4b7d992d-4737-41c9-b3c2-080be3406de0 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:13.299689 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-4b7d992d-4737-41c9-b3c2-080be3406de0 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a8838f167743678110ca0a9d5a2484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10ed49573f464cc18794b94fd1c115ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:38:13.311744 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-4b7d992d-4737-41c9-b3c2-080be3406de0 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] 10.222.0.45 "GET /compute/v2.1/servers/750f8ae5-b267-4b76-bb13-170071722932" status: 200 len: 1315 microversion: 2.1 time: 0.370821 Jan 21 09:38:13.327800 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 229/442] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:38:12 2022] GET /compute/v2.1/servers/750f8ae5-b267-4b76-bb13-170071722932 => generated 1315 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:38:13.335745 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-b20e9a57-8534-4a13-815c-e21f3ffd5a9b tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:38:13.340855 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-b20e9a57-8534-4a13-815c-e21f3ffd5a9b tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] [instance: deb54068-874d-4b55-ab9c-777c53b1d707] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:38:13.353723 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-b20e9a57-8534-4a13-815c-e21f3ffd5a9b tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:13.359462 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-b20e9a57-8534-4a13-815c-e21f3ffd5a9b tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:13.366041 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-b20e9a57-8534-4a13-815c-e21f3ffd5a9b tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:13.368231 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-b20e9a57-8534-4a13-815c-e21f3ffd5a9b tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:13.414274 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.wsgi [None req-b20e9a57-8534-4a13-815c-e21f3ffd5a9b tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] HTTP exception thrown: Instance deb54068-874d-4b55-ab9c-777c53b1d707 could not be found. Jan 21 09:38:13.416591 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-b20e9a57-8534-4a13-815c-e21f3ffd5a9b tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Returning 404 to user: Instance deb54068-874d-4b55-ab9c-777c53b1d707 could not be found. {{(pid=123387) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 21 09:38:13.422690 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-b20e9a57-8534-4a13-815c-e21f3ffd5a9b tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] 10.222.0.45 "GET /compute/v2.1/servers/deb54068-874d-4b55-ab9c-777c53b1d707" status: 404 len: 111 microversion: 2.1 time: 0.093357 Jan 21 09:38:13.428551 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 230/443] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:38:13 2022] GET /compute/v2.1/servers/deb54068-874d-4b55-ab9c-777c53b1d707 => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 21 09:38:13.436715 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [req-990c9ba9-05d9-4902-84d1-eb3fa6457741 req-d03534f2-ac20-498b-95bd-994f499cc2ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59ad64a5-af93-44ef-8031-fd2f2d18a901", "name": "network-vif-plugged", "status": "completed", "tag": "63990fa3-fce3-4891-adb2-cd4ebc4c075a"}]} {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:38:13.440027 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 21 09:38:13.440027 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: warnings.warn(msg) Jan 21 09:38:13.464175 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [req-990c9ba9-05d9-4902-84d1-eb3fa6457741 req-d03534f2-ac20-498b-95bd-994f499cc2ac service nova] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:13.468113 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [req-990c9ba9-05d9-4902-84d1-eb3fa6457741 req-d03534f2-ac20-498b-95bd-994f499cc2ac service nova] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:13.526900 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.compute.server_external_events [req-990c9ba9-05d9-4902-84d1-eb3fa6457741 req-d03534f2-ac20-498b-95bd-994f499cc2ac service nova] Creating event network-vif-plugged:63990fa3-fce3-4891-adb2-cd4ebc4c075a for instance 59ad64a5-af93-44ef-8031-fd2f2d18a901 on hv-cinder-80403 Jan 21 09:38:13.546218 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [req-990c9ba9-05d9-4902-84d1-eb3fa6457741 req-d03534f2-ac20-498b-95bd-994f499cc2ac service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115783 Jan 21 09:38:13.550948 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 231/444] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Jan 21 09:38:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 09:38:13.575886 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [req-21adeef1-6d39-4f4a-9016-6338affe049c req-0ae17e1f-e865-4469-9a20-1f9c0a850f9c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0f393a36-e048-4228-a48c-9ed725c3e71c", "tag": "3a1c611f-ef10-4e62-a802-09f927e4a0d9"}]} {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:38:13.590907 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 21 09:38:13.590907 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: warnings.warn(msg) Jan 21 09:38:13.625684 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [req-21adeef1-6d39-4f4a-9016-6338affe049c req-0ae17e1f-e865-4469-9a20-1f9c0a850f9c service nova] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:13.638101 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [req-21adeef1-6d39-4f4a-9016-6338affe049c req-0ae17e1f-e865-4469-9a20-1f9c0a850f9c service nova] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:13.712314 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.compute.server_external_events [req-21adeef1-6d39-4f4a-9016-6338affe049c req-0ae17e1f-e865-4469-9a20-1f9c0a850f9c service nova] Creating event network-changed:3a1c611f-ef10-4e62-a802-09f927e4a0d9 for instance 0f393a36-e048-4228-a48c-9ed725c3e71c on hv-cinder-80403 Jan 21 09:38:13.769636 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [req-21adeef1-6d39-4f4a-9016-6338affe049c req-0ae17e1f-e865-4469-9a20-1f9c0a850f9c service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.190637 Jan 21 09:38:13.770297 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 232/445] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Jan 21 09:38:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 09:38:13.812393 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [req-70d5bb4e-e752-41ff-a2b4-c47a7eef11ea req-5fcca06b-aae5-4c3e-b859-80497e07fb7a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a4e4d869-a178-4acd-8305-895d478f77ce", "tag": "c37f8b48-fdff-490a-a961-319445aac8a3"}]} {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:38:13.818631 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 21 09:38:13.818631 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: warnings.warn(msg) Jan 21 09:38:13.872517 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [req-70d5bb4e-e752-41ff-a2b4-c47a7eef11ea req-5fcca06b-aae5-4c3e-b859-80497e07fb7a service nova] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:13.878851 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [req-70d5bb4e-e752-41ff-a2b4-c47a7eef11ea req-5fcca06b-aae5-4c3e-b859-80497e07fb7a service nova] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:13.908946 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.compute.server_external_events [req-70d5bb4e-e752-41ff-a2b4-c47a7eef11ea req-5fcca06b-aae5-4c3e-b859-80497e07fb7a service nova] Creating event network-changed:c37f8b48-fdff-490a-a961-319445aac8a3 for instance a4e4d869-a178-4acd-8305-895d478f77ce on hv-cinder-80403 Jan 21 09:38:13.912076 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-2192f072-796a-4057-b732-c15c90455850 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7233857fe3a341b78e6449904cd935bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1d230932114019a989885b46cb9283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:38:13.921005 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [req-70d5bb4e-e752-41ff-a2b4-c47a7eef11ea req-5fcca06b-aae5-4c3e-b859-80497e07fb7a service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.137799 Jan 21 09:38:13.921866 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 233/446] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Jan 21 09:38:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 09:38:13.928383 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-2192f072-796a-4057-b732-c15c90455850 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] 10.222.0.45 "GET /compute/v2.1/servers/a4e4d869-a178-4acd-8305-895d478f77ce" status: 200 len: 1312 microversion: 2.1 time: 0.995419 Jan 21 09:38:13.930492 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 214/447] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:38:12 2022] GET /compute/v2.1/servers/a4e4d869-a178-4acd-8305-895d478f77ce => generated 1312 bytes in 998 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:38:13.941415 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-0f591421-7acd-4741-b480-ee0b0ee0692c tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:38:13.942452 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-0f591421-7acd-4741-b480-ee0b0ee0692c tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] [instance: 59ad64a5-af93-44ef-8031-fd2f2d18a901] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:38:13.952369 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-0f591421-7acd-4741-b480-ee0b0ee0692c tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:13.952369 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-0f591421-7acd-4741-b480-ee0b0ee0692c tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:13.959961 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-0f591421-7acd-4741-b480-ee0b0ee0692c tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:13.962829 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-051309e9-2cf2-470e-bac8-fb03919835c6 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:38:13.963435 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-0f591421-7acd-4741-b480-ee0b0ee0692c tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:13.966173 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-051309e9-2cf2-470e-bac8-fb03919835c6 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] [instance: 0f393a36-e048-4228-a48c-9ed725c3e71c] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:38:13.980691 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-051309e9-2cf2-470e-bac8-fb03919835c6 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:13.981564 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-051309e9-2cf2-470e-bac8-fb03919835c6 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:13.982665 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-051309e9-2cf2-470e-bac8-fb03919835c6 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:13.983369 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-051309e9-2cf2-470e-bac8-fb03919835c6 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:14.917910 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-051309e9-2cf2-470e-bac8-fb03919835c6 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7b2c14d9444d65ab7a874e749671bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3390729231b409e9a83376b428c1a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:38:14.937875 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-051309e9-2cf2-470e-bac8-fb03919835c6 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] 10.222.0.45 "GET /compute/v2.1/servers/0f393a36-e048-4228-a48c-9ed725c3e71c" status: 200 len: 1318 microversion: 2.1 time: 0.984868 Jan 21 09:38:14.951973 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 215/448] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:38:13 2022] GET /compute/v2.1/servers/0f393a36-e048-4228-a48c-9ed725c3e71c => generated 1318 bytes in 1007 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:38:14.964211 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-69646518-51f2-4ac7-81ac-d572883e9f50 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:38:14.965427 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-69646518-51f2-4ac7-81ac-d572883e9f50 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] [instance: 750f8ae5-b267-4b76-bb13-170071722932] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:38:14.997468 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-0f591421-7acd-4741-b480-ee0b0ee0692c tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:38:15.013779 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-0f591421-7acd-4741-b480-ee0b0ee0692c tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:38:15.014507 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-69646518-51f2-4ac7-81ac-d572883e9f50 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:15.015212 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-69646518-51f2-4ac7-81ac-d572883e9f50 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:15.016219 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-69646518-51f2-4ac7-81ac-d572883e9f50 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:15.016861 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-69646518-51f2-4ac7-81ac-d572883e9f50 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:15.023592 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-0f591421-7acd-4741-b480-ee0b0ee0692c tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:38:15.028626 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-0f591421-7acd-4741-b480-ee0b0ee0692c tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "GET /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901" status: 200 len: 1739 microversion: 2.20 time: 1.088606 Jan 21 09:38:15.046079 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 234/449] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jan 21 09:38:13 2022] GET /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901 => generated 1739 bytes in 1110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 21 09:38:15.057646 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-b18948ad-2bbe-4522-a602-83ac1c94b0cb tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:38:15.067757 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-b18948ad-2bbe-4522-a602-83ac1c94b0cb tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] [instance: a4e4d869-a178-4acd-8305-895d478f77ce] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:38:15.087456 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-b18948ad-2bbe-4522-a602-83ac1c94b0cb tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:15.092204 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-b18948ad-2bbe-4522-a602-83ac1c94b0cb tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:15.093104 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-b18948ad-2bbe-4522-a602-83ac1c94b0cb tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:15.093571 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-b18948ad-2bbe-4522-a602-83ac1c94b0cb tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:15.571893 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-69646518-51f2-4ac7-81ac-d572883e9f50 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a8838f167743678110ca0a9d5a2484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10ed49573f464cc18794b94fd1c115ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:38:15.583677 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-69646518-51f2-4ac7-81ac-d572883e9f50 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] 10.222.0.45 "GET /compute/v2.1/servers/750f8ae5-b267-4b76-bb13-170071722932" status: 200 len: 1357 microversion: 2.1 time: 0.629538 Jan 21 09:38:15.585506 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 216/450] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:38:14 2022] GET /compute/v2.1/servers/750f8ae5-b267-4b76-bb13-170071722932 => generated 1357 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:38:15.624871 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-b18948ad-2bbe-4522-a602-83ac1c94b0cb tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7233857fe3a341b78e6449904cd935bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1d230932114019a989885b46cb9283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:38:15.636375 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-b18948ad-2bbe-4522-a602-83ac1c94b0cb tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] 10.222.0.45 "GET /compute/v2.1/servers/a4e4d869-a178-4acd-8305-895d478f77ce" status: 200 len: 1312 microversion: 2.1 time: 0.588088 Jan 21 09:38:15.636375 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 235/451] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:38:15 2022] GET /compute/v2.1/servers/a4e4d869-a178-4acd-8305-895d478f77ce => generated 1312 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:38:15.958799 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-9aa8ca9a-1dac-4af8-8c26-47088cf82424 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:38:15.960992 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-9aa8ca9a-1dac-4af8-8c26-47088cf82424 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] [instance: 0f393a36-e048-4228-a48c-9ed725c3e71c] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:38:15.970095 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-9aa8ca9a-1dac-4af8-8c26-47088cf82424 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:15.970822 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-9aa8ca9a-1dac-4af8-8c26-47088cf82424 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:15.972399 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-9aa8ca9a-1dac-4af8-8c26-47088cf82424 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:15.973180 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-9aa8ca9a-1dac-4af8-8c26-47088cf82424 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:16.049740 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-5dc63c8f-1757-4de9-beb3-63b2052cb827 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:38:16.051079 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-5dc63c8f-1757-4de9-beb3-63b2052cb827 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] [instance: 59ad64a5-af93-44ef-8031-fd2f2d18a901] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:38:16.066365 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-5dc63c8f-1757-4de9-beb3-63b2052cb827 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:16.068528 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-5dc63c8f-1757-4de9-beb3-63b2052cb827 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:16.073492 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-5dc63c8f-1757-4de9-beb3-63b2052cb827 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:16.074213 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-5dc63c8f-1757-4de9-beb3-63b2052cb827 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:16.164728 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-9aa8ca9a-1dac-4af8-8c26-47088cf82424 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7b2c14d9444d65ab7a874e749671bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3390729231b409e9a83376b428c1a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:38:16.182577 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-9aa8ca9a-1dac-4af8-8c26-47088cf82424 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] 10.222.0.45 "GET /compute/v2.1/servers/0f393a36-e048-4228-a48c-9ed725c3e71c" status: 200 len: 1318 microversion: 2.1 time: 0.227940 Jan 21 09:38:16.184832 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 217/452] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:38:15 2022] GET /compute/v2.1/servers/0f393a36-e048-4228-a48c-9ed725c3e71c => generated 1318 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 09:38:16.406051 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-5dc63c8f-1757-4de9-beb3-63b2052cb827 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:38:16.426672 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-5dc63c8f-1757-4de9-beb3-63b2052cb827 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:38:16.432259 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-5dc63c8f-1757-4de9-beb3-63b2052cb827 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:38:16.435852 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-5dc63c8f-1757-4de9-beb3-63b2052cb827 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "GET /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901" status: 200 len: 1739 microversion: 2.20 time: 0.390166 Jan 21 09:38:16.438859 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 236/453] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jan 21 09:38:16 2022] GET /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901 => generated 1739 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 21 09:38:16.614601 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-79823e6f-967e-4d55-8315-259380b77ba1 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:38:16.616655 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-79823e6f-967e-4d55-8315-259380b77ba1 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] [instance: 750f8ae5-b267-4b76-bb13-170071722932] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:38:16.633049 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-79823e6f-967e-4d55-8315-259380b77ba1 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:16.636882 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-79823e6f-967e-4d55-8315-259380b77ba1 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:16.636882 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-79823e6f-967e-4d55-8315-259380b77ba1 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:16.637736 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-79823e6f-967e-4d55-8315-259380b77ba1 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:16.662130 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-031ab407-755c-4a3d-8c0c-78fe553e2180 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:38:16.664556 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-031ab407-755c-4a3d-8c0c-78fe553e2180 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] [instance: a4e4d869-a178-4acd-8305-895d478f77ce] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:38:16.680050 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-031ab407-755c-4a3d-8c0c-78fe553e2180 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:16.680050 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-031ab407-755c-4a3d-8c0c-78fe553e2180 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:16.683154 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-031ab407-755c-4a3d-8c0c-78fe553e2180 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:16.683938 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-031ab407-755c-4a3d-8c0c-78fe553e2180 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:17.131652 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-79823e6f-967e-4d55-8315-259380b77ba1 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a8838f167743678110ca0a9d5a2484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10ed49573f464cc18794b94fd1c115ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:38:17.146823 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-79823e6f-967e-4d55-8315-259380b77ba1 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] 10.222.0.45 "GET /compute/v2.1/servers/750f8ae5-b267-4b76-bb13-170071722932" status: 200 len: 1357 microversion: 2.1 time: 0.539295 Jan 21 09:38:17.150149 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 218/454] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:38:16 2022] GET /compute/v2.1/servers/750f8ae5-b267-4b76-bb13-170071722932 => generated 1357 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:38:17.196255 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-031ab407-755c-4a3d-8c0c-78fe553e2180 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7233857fe3a341b78e6449904cd935bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1d230932114019a989885b46cb9283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:38:17.206279 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-9eca7fa9-2b3c-46bb-a307-a7b52c81136b tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:38:17.208251 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-9eca7fa9-2b3c-46bb-a307-a7b52c81136b tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] [instance: 0f393a36-e048-4228-a48c-9ed725c3e71c] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:38:17.210430 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-031ab407-755c-4a3d-8c0c-78fe553e2180 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] 10.222.0.45 "GET /compute/v2.1/servers/a4e4d869-a178-4acd-8305-895d478f77ce" status: 200 len: 1312 microversion: 2.1 time: 0.558708 Jan 21 09:38:17.211343 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 237/455] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:38:16 2022] GET /compute/v2.1/servers/a4e4d869-a178-4acd-8305-895d478f77ce => generated 1312 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:38:17.240068 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-9eca7fa9-2b3c-46bb-a307-a7b52c81136b tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:17.240939 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-9eca7fa9-2b3c-46bb-a307-a7b52c81136b tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:17.241975 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-9eca7fa9-2b3c-46bb-a307-a7b52c81136b tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:17.242865 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-9eca7fa9-2b3c-46bb-a307-a7b52c81136b tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:17.467366 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-b0d9935b-657a-49b2-93ae-aae69e02f813 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:38:17.472584 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-b0d9935b-657a-49b2-93ae-aae69e02f813 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] [instance: 59ad64a5-af93-44ef-8031-fd2f2d18a901] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:38:17.488770 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-b0d9935b-657a-49b2-93ae-aae69e02f813 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:17.492969 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-b0d9935b-657a-49b2-93ae-aae69e02f813 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:17.492969 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-b0d9935b-657a-49b2-93ae-aae69e02f813 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:17.492969 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-b0d9935b-657a-49b2-93ae-aae69e02f813 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:17.538484 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-9eca7fa9-2b3c-46bb-a307-a7b52c81136b tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7b2c14d9444d65ab7a874e749671bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3390729231b409e9a83376b428c1a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:38:17.556461 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-9eca7fa9-2b3c-46bb-a307-a7b52c81136b tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] 10.222.0.45 "GET /compute/v2.1/servers/0f393a36-e048-4228-a48c-9ed725c3e71c" status: 200 len: 1318 microversion: 2.1 time: 0.360264 Jan 21 09:38:17.577954 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 219/456] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:38:17 2022] GET /compute/v2.1/servers/0f393a36-e048-4228-a48c-9ed725c3e71c => generated 1318 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 09:38:17.982755 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-b0d9935b-657a-49b2-93ae-aae69e02f813 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:38:18.017908 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-b0d9935b-657a-49b2-93ae-aae69e02f813 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:38:18.023924 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-b0d9935b-657a-49b2-93ae-aae69e02f813 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:38:18.041027 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-b0d9935b-657a-49b2-93ae-aae69e02f813 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "GET /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901" status: 200 len: 1739 microversion: 2.20 time: 0.573422 Jan 21 09:38:18.041027 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 238/457] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jan 21 09:38:17 2022] GET /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901 => generated 1739 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 21 09:38:18.171166 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-c2689aaf-77bc-4cb5-b6c9-8b21ff0b2817 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:38:18.172574 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-c2689aaf-77bc-4cb5-b6c9-8b21ff0b2817 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] [instance: 750f8ae5-b267-4b76-bb13-170071722932] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:38:18.194174 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-c2689aaf-77bc-4cb5-b6c9-8b21ff0b2817 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:18.200574 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-c2689aaf-77bc-4cb5-b6c9-8b21ff0b2817 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:18.201836 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-c2689aaf-77bc-4cb5-b6c9-8b21ff0b2817 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:18.202498 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-c2689aaf-77bc-4cb5-b6c9-8b21ff0b2817 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:18.233457 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-2090632f-46c0-4244-aa54-9ae1058e03e4 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:38:18.234122 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-2090632f-46c0-4244-aa54-9ae1058e03e4 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] [instance: a4e4d869-a178-4acd-8305-895d478f77ce] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:38:18.279379 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-2090632f-46c0-4244-aa54-9ae1058e03e4 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:18.281875 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-2090632f-46c0-4244-aa54-9ae1058e03e4 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:18.283023 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-2090632f-46c0-4244-aa54-9ae1058e03e4 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:18.283463 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-2090632f-46c0-4244-aa54-9ae1058e03e4 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:19.489742 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-2090632f-46c0-4244-aa54-9ae1058e03e4 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7233857fe3a341b78e6449904cd935bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1d230932114019a989885b46cb9283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:38:19.495072 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-c2689aaf-77bc-4cb5-b6c9-8b21ff0b2817 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a8838f167743678110ca0a9d5a2484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10ed49573f464cc18794b94fd1c115ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:38:19.510933 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-2090632f-46c0-4244-aa54-9ae1058e03e4 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] 10.222.0.45 "GET /compute/v2.1/servers/a4e4d869-a178-4acd-8305-895d478f77ce" status: 200 len: 1312 microversion: 2.1 time: 1.279645 Jan 21 09:38:19.522775 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 239/458] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:38:18 2022] GET /compute/v2.1/servers/a4e4d869-a178-4acd-8305-895d478f77ce => generated 1312 bytes in 1287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:38:19.522775 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-328f6a8e-7705-4ec2-ad3e-7eca61d5092a tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:38:19.522775 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-328f6a8e-7705-4ec2-ad3e-7eca61d5092a tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] [instance: 0f393a36-e048-4228-a48c-9ed725c3e71c] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:38:19.531077 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-c2689aaf-77bc-4cb5-b6c9-8b21ff0b2817 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] 10.222.0.45 "GET /compute/v2.1/servers/750f8ae5-b267-4b76-bb13-170071722932" status: 200 len: 1357 microversion: 2.1 time: 1.364553 Jan 21 09:38:19.531673 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 220/459] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:38:18 2022] GET /compute/v2.1/servers/750f8ae5-b267-4b76-bb13-170071722932 => generated 1357 bytes in 1366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:38:19.536056 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-328f6a8e-7705-4ec2-ad3e-7eca61d5092a tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:19.536728 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-328f6a8e-7705-4ec2-ad3e-7eca61d5092a tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:19.537968 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-328f6a8e-7705-4ec2-ad3e-7eca61d5092a tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:19.538599 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-328f6a8e-7705-4ec2-ad3e-7eca61d5092a tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:19.556056 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-0547030f-590f-482c-aea3-fbf699b8740f tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:38:19.559236 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-0547030f-590f-482c-aea3-fbf699b8740f tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] [instance: 59ad64a5-af93-44ef-8031-fd2f2d18a901] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:38:19.572538 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-0547030f-590f-482c-aea3-fbf699b8740f tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:19.572980 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-0547030f-590f-482c-aea3-fbf699b8740f tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:19.577549 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-0547030f-590f-482c-aea3-fbf699b8740f tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:19.577549 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-0547030f-590f-482c-aea3-fbf699b8740f tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:20.322020 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-328f6a8e-7705-4ec2-ad3e-7eca61d5092a tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7b2c14d9444d65ab7a874e749671bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3390729231b409e9a83376b428c1a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:38:20.322348 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-0547030f-590f-482c-aea3-fbf699b8740f tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:38:20.332645 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-328f6a8e-7705-4ec2-ad3e-7eca61d5092a tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] 10.222.0.45 "GET /compute/v2.1/servers/0f393a36-e048-4228-a48c-9ed725c3e71c" status: 200 len: 1318 microversion: 2.1 time: 0.819364 Jan 21 09:38:20.334606 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 240/460] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:38:19 2022] GET /compute/v2.1/servers/0f393a36-e048-4228-a48c-9ed725c3e71c => generated 1318 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:38:20.358241 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-0547030f-590f-482c-aea3-fbf699b8740f tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:38:20.363787 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-0547030f-590f-482c-aea3-fbf699b8740f tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:38:20.367844 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-0547030f-590f-482c-aea3-fbf699b8740f tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "GET /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901" status: 200 len: 1739 microversion: 2.20 time: 0.830430 Jan 21 09:38:20.370530 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 221/461] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jan 21 09:38:19 2022] GET /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901 => generated 1739 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 21 09:38:20.532087 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-a859b29d-e8da-4a7c-a420-7d3b79659278 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:38:20.534664 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-a859b29d-e8da-4a7c-a420-7d3b79659278 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] [instance: a4e4d869-a178-4acd-8305-895d478f77ce] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:38:20.542156 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-a859b29d-e8da-4a7c-a420-7d3b79659278 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:20.549096 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-09e1bd6a-e30e-4717-a890-bbd39731e9a2 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:38:20.550762 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-09e1bd6a-e30e-4717-a890-bbd39731e9a2 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] [instance: 750f8ae5-b267-4b76-bb13-170071722932] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:38:20.552929 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-a859b29d-e8da-4a7c-a420-7d3b79659278 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:20.555598 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-a859b29d-e8da-4a7c-a420-7d3b79659278 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:20.558068 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-a859b29d-e8da-4a7c-a420-7d3b79659278 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:20.562030 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-09e1bd6a-e30e-4717-a890-bbd39731e9a2 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:20.564466 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-09e1bd6a-e30e-4717-a890-bbd39731e9a2 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:20.565852 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-09e1bd6a-e30e-4717-a890-bbd39731e9a2 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:20.566652 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-09e1bd6a-e30e-4717-a890-bbd39731e9a2 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:21.229635 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-a859b29d-e8da-4a7c-a420-7d3b79659278 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7233857fe3a341b78e6449904cd935bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1d230932114019a989885b46cb9283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:38:21.257488 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-a859b29d-e8da-4a7c-a420-7d3b79659278 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] 10.222.0.45 "GET /compute/v2.1/servers/a4e4d869-a178-4acd-8305-895d478f77ce" status: 200 len: 1312 microversion: 2.1 time: 0.712132 Jan 21 09:38:21.257488 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 241/462] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:38:20 2022] GET /compute/v2.1/servers/a4e4d869-a178-4acd-8305-895d478f77ce => generated 1312 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:38:21.272099 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-09e1bd6a-e30e-4717-a890-bbd39731e9a2 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a8838f167743678110ca0a9d5a2484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10ed49573f464cc18794b94fd1c115ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:38:21.285068 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-09e1bd6a-e30e-4717-a890-bbd39731e9a2 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] 10.222.0.45 "GET /compute/v2.1/servers/750f8ae5-b267-4b76-bb13-170071722932" status: 200 len: 1357 microversion: 2.1 time: 0.740234 Jan 21 09:38:21.316701 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 222/463] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:38:20 2022] GET /compute/v2.1/servers/750f8ae5-b267-4b76-bb13-170071722932 => generated 1357 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 09:38:21.358257 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-bd85d963-3444-4f58-a0e1-64d367cc6f2d tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:38:21.358945 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-bd85d963-3444-4f58-a0e1-64d367cc6f2d tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] [instance: 0f393a36-e048-4228-a48c-9ed725c3e71c] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:38:21.374335 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-bd85d963-3444-4f58-a0e1-64d367cc6f2d tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:21.375097 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-bd85d963-3444-4f58-a0e1-64d367cc6f2d tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:21.386576 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-bd85d963-3444-4f58-a0e1-64d367cc6f2d tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:21.387182 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-bd85d963-3444-4f58-a0e1-64d367cc6f2d tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:21.408536 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-b598c359-07f0-4106-a882-0bc9278a0b8d tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:38:21.410174 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-b598c359-07f0-4106-a882-0bc9278a0b8d tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] [instance: 59ad64a5-af93-44ef-8031-fd2f2d18a901] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:38:21.453614 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-b598c359-07f0-4106-a882-0bc9278a0b8d tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:21.461776 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-b598c359-07f0-4106-a882-0bc9278a0b8d tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:21.466955 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-b598c359-07f0-4106-a882-0bc9278a0b8d tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:21.472964 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-b598c359-07f0-4106-a882-0bc9278a0b8d tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:22.435903 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-b598c359-07f0-4106-a882-0bc9278a0b8d tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:38:22.450474 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-b598c359-07f0-4106-a882-0bc9278a0b8d tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:38:22.452277 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-b598c359-07f0-4106-a882-0bc9278a0b8d tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:38:22.461180 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-b598c359-07f0-4106-a882-0bc9278a0b8d tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "GET /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901" status: 200 len: 1739 microversion: 2.20 time: 1.065865 Jan 21 09:38:22.466801 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 223/464] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jan 21 09:38:21 2022] GET /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901 => generated 1739 bytes in 1068 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 21 09:38:22.475879 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-6a63a6e2-55fc-42dc-bede-b79f11a1fce9 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:38:22.484027 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-6a63a6e2-55fc-42dc-bede-b79f11a1fce9 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] [instance: 4e67b25e-7e65-4975-bafa-fceafcd53647] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:38:22.518104 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-6a63a6e2-55fc-42dc-bede-b79f11a1fce9 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:22.519461 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-6a63a6e2-55fc-42dc-bede-b79f11a1fce9 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:22.520339 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-6a63a6e2-55fc-42dc-bede-b79f11a1fce9 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:22.520778 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-6a63a6e2-55fc-42dc-bede-b79f11a1fce9 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:22.580660 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-bd85d963-3444-4f58-a0e1-64d367cc6f2d tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7b2c14d9444d65ab7a874e749671bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3390729231b409e9a83376b428c1a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:38:22.606334 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.objects.instance [None req-6a63a6e2-55fc-42dc-bede-b79f11a1fce9 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lazy-loading 'flavor' on Instance uuid 4e67b25e-7e65-4975-bafa-fceafcd53647 {{(pid=123386) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 21 09:38:22.660768 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-bd85d963-3444-4f58-a0e1-64d367cc6f2d tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] 10.222.0.45 "GET /compute/v2.1/servers/0f393a36-e048-4228-a48c-9ed725c3e71c" status: 200 len: 1318 microversion: 2.1 time: 1.309771 Jan 21 09:38:22.661902 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 242/465] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:38:21 2022] GET /compute/v2.1/servers/0f393a36-e048-4228-a48c-9ed725c3e71c => generated 1318 bytes in 1314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:38:22.680312 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-978a345a-3135-47d5-9c51-53f39ad38464 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:38:22.686345 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-978a345a-3135-47d5-9c51-53f39ad38464 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] [instance: a4e4d869-a178-4acd-8305-895d478f77ce] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:38:22.712246 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-978a345a-3135-47d5-9c51-53f39ad38464 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:22.717753 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-978a345a-3135-47d5-9c51-53f39ad38464 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:22.720286 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-978a345a-3135-47d5-9c51-53f39ad38464 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:22.722074 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-978a345a-3135-47d5-9c51-53f39ad38464 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:23.134434 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-978a345a-3135-47d5-9c51-53f39ad38464 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7233857fe3a341b78e6449904cd935bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1d230932114019a989885b46cb9283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:38:23.147021 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-978a345a-3135-47d5-9c51-53f39ad38464 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] 10.222.0.45 "GET /compute/v2.1/servers/a4e4d869-a178-4acd-8305-895d478f77ce" status: 200 len: 1312 microversion: 2.1 time: 0.481715 Jan 21 09:38:23.147690 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 243/466] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:38:22 2022] GET /compute/v2.1/servers/a4e4d869-a178-4acd-8305-895d478f77ce => generated 1312 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:38:23.181055 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-6a63a6e2-55fc-42dc-bede-b79f11a1fce9 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] 10.222.0.45 "POST /compute/v2.1/servers/4e67b25e-7e65-4975-bafa-fceafcd53647/action" status: 200 len: 32 microversion: 2.1 time: 0.712115 Jan 21 09:38:23.187899 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 224/467] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Jan 21 09:38:22 2022] POST /compute/v2.1/servers/4e67b25e-7e65-4975-bafa-fceafcd53647/action => generated 32 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 21 09:38:23.188082 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-9b830d9a-66a8-4d6a-8ed4-3b70d99dcfbf tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:38:23.188082 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-9b830d9a-66a8-4d6a-8ed4-3b70d99dcfbf tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] [instance: 750f8ae5-b267-4b76-bb13-170071722932] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:38:23.200924 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [req-8c7b204f-ac11-47b7-b3f3-4f8104e6a00c req-612226d8-82a2-4b11-94e2-cfcaa97b4844 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "750f8ae5-b267-4b76-bb13-170071722932", "tag": "d22f9cde-e9ce-4b37-9b2a-f673b65a0353"}]} {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:38:23.204964 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-9b830d9a-66a8-4d6a-8ed4-3b70d99dcfbf tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:23.205647 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-9b830d9a-66a8-4d6a-8ed4-3b70d99dcfbf tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:23.207585 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-9b830d9a-66a8-4d6a-8ed4-3b70d99dcfbf tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:23.207891 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 21 09:38:23.207891 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: warnings.warn(msg) Jan 21 09:38:23.208541 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-9b830d9a-66a8-4d6a-8ed4-3b70d99dcfbf tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:23.238445 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [req-8c7b204f-ac11-47b7-b3f3-4f8104e6a00c req-612226d8-82a2-4b11-94e2-cfcaa97b4844 service nova] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:23.238445 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [req-8c7b204f-ac11-47b7-b3f3-4f8104e6a00c req-612226d8-82a2-4b11-94e2-cfcaa97b4844 service nova] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:23.285461 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.compute.server_external_events [req-8c7b204f-ac11-47b7-b3f3-4f8104e6a00c req-612226d8-82a2-4b11-94e2-cfcaa97b4844 service nova] Creating event network-changed:d22f9cde-e9ce-4b37-9b2a-f673b65a0353 for instance 750f8ae5-b267-4b76-bb13-170071722932 on hv-cinder-80403 Jan 21 09:38:23.296207 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [req-8c7b204f-ac11-47b7-b3f3-4f8104e6a00c req-612226d8-82a2-4b11-94e2-cfcaa97b4844 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110592 Jan 21 09:38:23.297304 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 225/468] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Jan 21 09:38:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 09:38:23.319462 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-29598a77-dde6-4468-bbb7-9614744aa34e tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:38:23.324372 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-29598a77-dde6-4468-bbb7-9614744aa34e tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] [instance: 4e67b25e-7e65-4975-bafa-fceafcd53647] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:38:23.349216 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-29598a77-dde6-4468-bbb7-9614744aa34e tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:23.349971 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-29598a77-dde6-4468-bbb7-9614744aa34e tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:23.350824 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-29598a77-dde6-4468-bbb7-9614744aa34e tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:23.351258 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-29598a77-dde6-4468-bbb7-9614744aa34e tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:23.874712 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-9b830d9a-66a8-4d6a-8ed4-3b70d99dcfbf tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a8838f167743678110ca0a9d5a2484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10ed49573f464cc18794b94fd1c115ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:38:23.874712 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-9b830d9a-66a8-4d6a-8ed4-3b70d99dcfbf tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] 10.222.0.45 "GET /compute/v2.1/servers/750f8ae5-b267-4b76-bb13-170071722932" status: 200 len: 1357 microversion: 2.1 time: 0.710988 Jan 21 09:38:23.874712 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 244/469] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:38:23 2022] GET /compute/v2.1/servers/750f8ae5-b267-4b76-bb13-170071722932 => generated 1357 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:38:23.882201 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-123f0bed-81c1-42f7-ae7c-242979c6fa8a tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:38:23.883215 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-123f0bed-81c1-42f7-ae7c-242979c6fa8a tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] [instance: 59ad64a5-af93-44ef-8031-fd2f2d18a901] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:38:23.933674 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-29598a77-dde6-4468-bbb7-9614744aa34e tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db87258db1424ce7a8399fdd05efe3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89d1b21ad8471a8a9a82adac2594c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:38:23.937607 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-123f0bed-81c1-42f7-ae7c-242979c6fa8a tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:23.943064 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-123f0bed-81c1-42f7-ae7c-242979c6fa8a tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.049s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:23.944432 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-123f0bed-81c1-42f7-ae7c-242979c6fa8a tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:23.947775 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-123f0bed-81c1-42f7-ae7c-242979c6fa8a tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:23.956830 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-29598a77-dde6-4468-bbb7-9614744aa34e tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] 10.222.0.45 "GET /compute/v2.1/servers/4e67b25e-7e65-4975-bafa-fceafcd53647" status: 200 len: 1566 microversion: 2.1 time: 0.658246 Jan 21 09:38:23.960375 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 226/470] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:38:23 2022] GET /compute/v2.1/servers/4e67b25e-7e65-4975-bafa-fceafcd53647 => generated 1566 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:38:23.976508 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-1e7cdfed-97e0-49a7-ade7-4342349c5568 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:38:23.977565 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-1e7cdfed-97e0-49a7-ade7-4342349c5568 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] [instance: 0f393a36-e048-4228-a48c-9ed725c3e71c] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:38:23.999459 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-1e7cdfed-97e0-49a7-ade7-4342349c5568 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:24.000268 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-1e7cdfed-97e0-49a7-ade7-4342349c5568 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:24.001571 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-1e7cdfed-97e0-49a7-ade7-4342349c5568 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:24.006633 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-1e7cdfed-97e0-49a7-ade7-4342349c5568 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:24.698215 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-1e7cdfed-97e0-49a7-ade7-4342349c5568 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7b2c14d9444d65ab7a874e749671bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3390729231b409e9a83376b428c1a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:38:24.717031 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-1e7cdfed-97e0-49a7-ade7-4342349c5568 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] 10.222.0.45 "GET /compute/v2.1/servers/0f393a36-e048-4228-a48c-9ed725c3e71c" status: 200 len: 1318 microversion: 2.1 time: 0.750980 Jan 21 09:38:24.726137 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 227/471] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:38:23 2022] GET /compute/v2.1/servers/0f393a36-e048-4228-a48c-9ed725c3e71c => generated 1318 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:38:24.737470 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-123f0bed-81c1-42f7-ae7c-242979c6fa8a tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:38:24.738192 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-fbce9a3e-be08-4953-9034-cf31849f5ffd tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:38:24.739217 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-fbce9a3e-be08-4953-9034-cf31849f5ffd tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] [instance: a4e4d869-a178-4acd-8305-895d478f77ce] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:38:24.747205 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-fbce9a3e-be08-4953-9034-cf31849f5ffd tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:24.749433 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-fbce9a3e-be08-4953-9034-cf31849f5ffd tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:24.751010 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-fbce9a3e-be08-4953-9034-cf31849f5ffd tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:24.751885 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-123f0bed-81c1-42f7-ae7c-242979c6fa8a tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:38:24.753495 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-fbce9a3e-be08-4953-9034-cf31849f5ffd tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:24.758791 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-123f0bed-81c1-42f7-ae7c-242979c6fa8a tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:38:24.764078 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-123f0bed-81c1-42f7-ae7c-242979c6fa8a tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "GET /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901" status: 200 len: 1739 microversion: 2.20 time: 0.885949 Jan 21 09:38:24.774771 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 245/472] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jan 21 09:38:23 2022] GET /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901 => generated 1739 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 21 09:38:24.900875 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-c3627018-8981-4822-b3f8-357630088cdf tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:38:24.902570 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-c3627018-8981-4822-b3f8-357630088cdf tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] [instance: 750f8ae5-b267-4b76-bb13-170071722932] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:38:24.914488 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-c3627018-8981-4822-b3f8-357630088cdf tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:24.915026 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-c3627018-8981-4822-b3f8-357630088cdf tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:24.916090 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-c3627018-8981-4822-b3f8-357630088cdf tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:24.916546 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-c3627018-8981-4822-b3f8-357630088cdf tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:25.276277 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-fbce9a3e-be08-4953-9034-cf31849f5ffd tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7233857fe3a341b78e6449904cd935bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1d230932114019a989885b46cb9283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:38:25.294048 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-fbce9a3e-be08-4953-9034-cf31849f5ffd tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] 10.222.0.45 "GET /compute/v2.1/servers/a4e4d869-a178-4acd-8305-895d478f77ce" status: 200 len: 1312 microversion: 2.1 time: 0.559431 Jan 21 09:38:25.295824 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 228/473] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:38:24 2022] GET /compute/v2.1/servers/a4e4d869-a178-4acd-8305-895d478f77ce => generated 1312 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:38:25.310338 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-052244af-681e-4675-8271-bfe017c5962f tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:38:25.318464 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-052244af-681e-4675-8271-bfe017c5962f tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] [instance: 4e67b25e-7e65-4975-bafa-fceafcd53647] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:38:25.334113 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-052244af-681e-4675-8271-bfe017c5962f tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:25.336181 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-052244af-681e-4675-8271-bfe017c5962f tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:25.344546 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-052244af-681e-4675-8271-bfe017c5962f tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:25.346087 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-052244af-681e-4675-8271-bfe017c5962f tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:25.502578 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-c3627018-8981-4822-b3f8-357630088cdf tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a8838f167743678110ca0a9d5a2484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10ed49573f464cc18794b94fd1c115ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:38:25.533348 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-c3627018-8981-4822-b3f8-357630088cdf tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] 10.222.0.45 "GET /compute/v2.1/servers/750f8ae5-b267-4b76-bb13-170071722932" status: 200 len: 1357 microversion: 2.1 time: 0.636684 Jan 21 09:38:25.547928 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 246/474] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:38:24 2022] GET /compute/v2.1/servers/750f8ae5-b267-4b76-bb13-170071722932 => generated 1357 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 09:38:25.625446 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-c3aa25fb-a381-4fd6-b746-32873545edc8 tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1888598507", "imageRef": "813e53ee-82e7-4a13-9f63-a8be7b1089f1", "flavorRef": "452", "networks": [{"uuid": "7ccd0197-ed42-4d03-8ffc-af304fe19f70"}]}} {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:38:25.805828 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-052244af-681e-4675-8271-bfe017c5962f tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db87258db1424ce7a8399fdd05efe3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89d1b21ad8471a8a9a82adac2594c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:38:25.828262 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-052244af-681e-4675-8271-bfe017c5962f tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] 10.222.0.45 "GET /compute/v2.1/servers/4e67b25e-7e65-4975-bafa-fceafcd53647" status: 200 len: 1566 microversion: 2.1 time: 0.527816 Jan 21 09:38:25.833344 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 229/475] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:38:25 2022] GET /compute/v2.1/servers/4e67b25e-7e65-4975-bafa-fceafcd53647 => generated 1566 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:38:25.840135 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-8ef2cb96-4d8d-42a4-a8cd-f33e58a8367b tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:38:25.851990 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-8ef2cb96-4d8d-42a4-a8cd-f33e58a8367b tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] [instance: 0f393a36-e048-4228-a48c-9ed725c3e71c] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:38:25.902335 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-8ef2cb96-4d8d-42a4-a8cd-f33e58a8367b tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:25.905258 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-8ef2cb96-4d8d-42a4-a8cd-f33e58a8367b tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:25.915690 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-8ef2cb96-4d8d-42a4-a8cd-f33e58a8367b tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:25.916752 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-8ef2cb96-4d8d-42a4-a8cd-f33e58a8367b tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:26.533523 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-8ef2cb96-4d8d-42a4-a8cd-f33e58a8367b tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7b2c14d9444d65ab7a874e749671bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3390729231b409e9a83376b428c1a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:38:26.562112 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-8ef2cb96-4d8d-42a4-a8cd-f33e58a8367b tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] 10.222.0.45 "GET /compute/v2.1/servers/0f393a36-e048-4228-a48c-9ed725c3e71c" status: 200 len: 1318 microversion: 2.1 time: 0.727229 Jan 21 09:38:26.562860 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 230/476] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:38:25 2022] GET /compute/v2.1/servers/0f393a36-e048-4228-a48c-9ed725c3e71c => generated 1318 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:38:26.576862 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-9a7e5701-f9d0-4bb4-b363-1f783f22a0ae tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:38:26.577593 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-9a7e5701-f9d0-4bb4-b363-1f783f22a0ae tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] [instance: 59ad64a5-af93-44ef-8031-fd2f2d18a901] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:38:26.604098 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-9a7e5701-f9d0-4bb4-b363-1f783f22a0ae tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:26.604783 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-9a7e5701-f9d0-4bb4-b363-1f783f22a0ae tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:26.605760 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-9a7e5701-f9d0-4bb4-b363-1f783f22a0ae tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:26.606271 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-9a7e5701-f9d0-4bb4-b363-1f783f22a0ae tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:27.166730 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-9a7e5701-f9d0-4bb4-b363-1f783f22a0ae tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:38:27.203972 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-9a7e5701-f9d0-4bb4-b363-1f783f22a0ae tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:38:27.209887 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-9a7e5701-f9d0-4bb4-b363-1f783f22a0ae tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:38:27.214865 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-9a7e5701-f9d0-4bb4-b363-1f783f22a0ae tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "GET /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901" status: 200 len: 1739 microversion: 2.20 time: 0.650805 Jan 21 09:38:27.230136 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 231/477] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jan 21 09:38:26 2022] GET /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901 => generated 1739 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 21 09:38:27.245346 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-886233ae-f77b-4d78-a019-9ee217f9b8f7 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:38:27.246547 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-886233ae-f77b-4d78-a019-9ee217f9b8f7 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] [instance: a4e4d869-a178-4acd-8305-895d478f77ce] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:38:27.259730 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-886233ae-f77b-4d78-a019-9ee217f9b8f7 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:27.260459 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-886233ae-f77b-4d78-a019-9ee217f9b8f7 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:27.261451 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-886233ae-f77b-4d78-a019-9ee217f9b8f7 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:27.263855 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-886233ae-f77b-4d78-a019-9ee217f9b8f7 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:28.435198 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-886233ae-f77b-4d78-a019-9ee217f9b8f7 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7233857fe3a341b78e6449904cd935bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1d230932114019a989885b46cb9283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:38:28.480325 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-886233ae-f77b-4d78-a019-9ee217f9b8f7 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] 10.222.0.45 "GET /compute/v2.1/servers/a4e4d869-a178-4acd-8305-895d478f77ce" status: 200 len: 1312 microversion: 2.1 time: 1.246199 Jan 21 09:38:28.486336 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 232/478] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:38:27 2022] GET /compute/v2.1/servers/a4e4d869-a178-4acd-8305-895d478f77ce => generated 1312 bytes in 1255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:38:28.494279 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-516ff5f9-9257-421f-b664-059b31f0723c tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:38:28.508201 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-516ff5f9-9257-421f-b664-059b31f0723c tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] [instance: 750f8ae5-b267-4b76-bb13-170071722932] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:38:28.553865 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-516ff5f9-9257-421f-b664-059b31f0723c tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:28.564326 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-516ff5f9-9257-421f-b664-059b31f0723c tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:28.566714 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-516ff5f9-9257-421f-b664-059b31f0723c tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:28.567452 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-516ff5f9-9257-421f-b664-059b31f0723c tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:29.572327 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-516ff5f9-9257-421f-b664-059b31f0723c tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a8838f167743678110ca0a9d5a2484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10ed49573f464cc18794b94fd1c115ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:38:29.594995 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-516ff5f9-9257-421f-b664-059b31f0723c tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] 10.222.0.45 "GET /compute/v2.1/servers/750f8ae5-b267-4b76-bb13-170071722932" status: 200 len: 1357 microversion: 2.1 time: 1.104047 Jan 21 09:38:29.595928 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 233/479] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:38:28 2022] GET /compute/v2.1/servers/750f8ae5-b267-4b76-bb13-170071722932 => generated 1357 bytes in 1108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:38:29.609427 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-c1e38824-7d12-4f6b-87e5-1b85461014b4 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:38:29.613639 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-c1e38824-7d12-4f6b-87e5-1b85461014b4 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] [instance: 4e67b25e-7e65-4975-bafa-fceafcd53647] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:38:29.630021 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-c1e38824-7d12-4f6b-87e5-1b85461014b4 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:29.630738 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-c1e38824-7d12-4f6b-87e5-1b85461014b4 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:29.633110 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-c1e38824-7d12-4f6b-87e5-1b85461014b4 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:29.634073 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-c1e38824-7d12-4f6b-87e5-1b85461014b4 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:30.224964 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-c1e38824-7d12-4f6b-87e5-1b85461014b4 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db87258db1424ce7a8399fdd05efe3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89d1b21ad8471a8a9a82adac2594c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:38:30.291089 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-c1e38824-7d12-4f6b-87e5-1b85461014b4 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] 10.222.0.45 "GET /compute/v2.1/servers/4e67b25e-7e65-4975-bafa-fceafcd53647" status: 200 len: 1566 microversion: 2.1 time: 0.691327 Jan 21 09:38:30.307295 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 234/480] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:38:29 2022] GET /compute/v2.1/servers/4e67b25e-7e65-4975-bafa-fceafcd53647 => generated 1566 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:38:30.351731 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-133128d3-ff02-43ff-a9dc-ddfba2c7fd59 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:38:30.358281 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-133128d3-ff02-43ff-a9dc-ddfba2c7fd59 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] [instance: 0f393a36-e048-4228-a48c-9ed725c3e71c] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:38:30.402660 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-133128d3-ff02-43ff-a9dc-ddfba2c7fd59 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:30.403541 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-133128d3-ff02-43ff-a9dc-ddfba2c7fd59 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:30.404583 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-133128d3-ff02-43ff-a9dc-ddfba2c7fd59 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:30.408658 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-133128d3-ff02-43ff-a9dc-ddfba2c7fd59 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:30.950272 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-133128d3-ff02-43ff-a9dc-ddfba2c7fd59 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7b2c14d9444d65ab7a874e749671bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3390729231b409e9a83376b428c1a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:38:30.965655 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-133128d3-ff02-43ff-a9dc-ddfba2c7fd59 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] 10.222.0.45 "GET /compute/v2.1/servers/0f393a36-e048-4228-a48c-9ed725c3e71c" status: 200 len: 1318 microversion: 2.1 time: 0.656708 Jan 21 09:38:30.976413 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 235/481] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:38:30 2022] GET /compute/v2.1/servers/0f393a36-e048-4228-a48c-9ed725c3e71c => generated 1318 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:38:30.977090 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-909898f3-0737-45b3-b0f2-0df98f043aff tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:38:30.981507 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-909898f3-0737-45b3-b0f2-0df98f043aff tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] [instance: 59ad64a5-af93-44ef-8031-fd2f2d18a901] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:38:31.001478 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-909898f3-0737-45b3-b0f2-0df98f043aff tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:31.004483 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-909898f3-0737-45b3-b0f2-0df98f043aff tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:31.026094 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-909898f3-0737-45b3-b0f2-0df98f043aff tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:31.028918 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-909898f3-0737-45b3-b0f2-0df98f043aff tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:31.423136 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-909898f3-0737-45b3-b0f2-0df98f043aff tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:38:31.435659 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-909898f3-0737-45b3-b0f2-0df98f043aff tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:38:31.437924 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-909898f3-0737-45b3-b0f2-0df98f043aff tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:38:31.439264 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-909898f3-0737-45b3-b0f2-0df98f043aff tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "GET /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901" status: 200 len: 1739 microversion: 2.20 time: 0.471395 Jan 21 09:38:31.449665 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 236/482] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jan 21 09:38:30 2022] GET /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901 => generated 1739 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 21 09:38:31.454818 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [req-6776a3c3-6592-4535-b567-36b839837519 req-91bd0c8a-30c1-48ce-9906-3ac24f2e7aa8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f393a36-e048-4228-a48c-9ed725c3e71c", "name": "network-vif-plugged", "status": "completed", "tag": "3a1c611f-ef10-4e62-a802-09f927e4a0d9"}]} {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:38:31.457837 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 21 09:38:31.457837 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: warnings.warn(msg) Jan 21 09:38:31.479194 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [req-6776a3c3-6592-4535-b567-36b839837519 req-91bd0c8a-30c1-48ce-9906-3ac24f2e7aa8 service nova] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:31.479429 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [req-6776a3c3-6592-4535-b567-36b839837519 req-91bd0c8a-30c1-48ce-9906-3ac24f2e7aa8 service nova] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:31.512738 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.compute.server_external_events [req-6776a3c3-6592-4535-b567-36b839837519 req-91bd0c8a-30c1-48ce-9906-3ac24f2e7aa8 service nova] Creating event network-vif-plugged:3a1c611f-ef10-4e62-a802-09f927e4a0d9 for instance 0f393a36-e048-4228-a48c-9ed725c3e71c on hv-cinder-80403 Jan 21 09:38:31.523756 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [req-6776a3c3-6592-4535-b567-36b839837519 req-91bd0c8a-30c1-48ce-9906-3ac24f2e7aa8 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078013 Jan 21 09:38:31.525194 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 237/483] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Jan 21 09:38:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 09:38:31.536915 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-d8bebd4e-5bbb-4d91-adab-13a1b696a2c2 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:38:31.544309 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-d8bebd4e-5bbb-4d91-adab-13a1b696a2c2 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] [instance: a4e4d869-a178-4acd-8305-895d478f77ce] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:38:31.554120 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-d8bebd4e-5bbb-4d91-adab-13a1b696a2c2 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:31.554575 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-d8bebd4e-5bbb-4d91-adab-13a1b696a2c2 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:31.557396 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-d8bebd4e-5bbb-4d91-adab-13a1b696a2c2 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:31.558182 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-d8bebd4e-5bbb-4d91-adab-13a1b696a2c2 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:31.887352 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-d8bebd4e-5bbb-4d91-adab-13a1b696a2c2 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7233857fe3a341b78e6449904cd935bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1d230932114019a989885b46cb9283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:38:31.894247 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-d8bebd4e-5bbb-4d91-adab-13a1b696a2c2 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] 10.222.0.45 "GET /compute/v2.1/servers/a4e4d869-a178-4acd-8305-895d478f77ce" status: 200 len: 1312 microversion: 2.1 time: 0.367389 Jan 21 09:38:31.899795 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 238/484] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:38:31 2022] GET /compute/v2.1/servers/a4e4d869-a178-4acd-8305-895d478f77ce => generated 1312 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:38:31.906042 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-fe65cb27-0115-4e11-8b57-37942890d938 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:38:31.913432 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-fe65cb27-0115-4e11-8b57-37942890d938 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] [instance: 750f8ae5-b267-4b76-bb13-170071722932] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:38:31.969314 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-fe65cb27-0115-4e11-8b57-37942890d938 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:31.974102 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-fe65cb27-0115-4e11-8b57-37942890d938 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:31.975243 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-fe65cb27-0115-4e11-8b57-37942890d938 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:31.975842 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-fe65cb27-0115-4e11-8b57-37942890d938 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:32.486123 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-fe65cb27-0115-4e11-8b57-37942890d938 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a8838f167743678110ca0a9d5a2484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10ed49573f464cc18794b94fd1c115ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:38:32.508059 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-fe65cb27-0115-4e11-8b57-37942890d938 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] 10.222.0.45 "GET /compute/v2.1/servers/750f8ae5-b267-4b76-bb13-170071722932" status: 200 len: 1357 microversion: 2.1 time: 0.606707 Jan 21 09:38:32.509118 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 239/485] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:38:31 2022] GET /compute/v2.1/servers/750f8ae5-b267-4b76-bb13-170071722932 => generated 1357 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:38:32.541864 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-9bd9ab21-c40c-4d2a-8193-dc16a695faec tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:38:32.542626 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-9bd9ab21-c40c-4d2a-8193-dc16a695faec tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] [instance: 4e67b25e-7e65-4975-bafa-fceafcd53647] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:38:32.581240 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-9bd9ab21-c40c-4d2a-8193-dc16a695faec tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:32.588209 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-9bd9ab21-c40c-4d2a-8193-dc16a695faec tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:32.591723 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-9bd9ab21-c40c-4d2a-8193-dc16a695faec tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:32.596436 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-9bd9ab21-c40c-4d2a-8193-dc16a695faec tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:32.901835 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-9bd9ab21-c40c-4d2a-8193-dc16a695faec tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db87258db1424ce7a8399fdd05efe3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89d1b21ad8471a8a9a82adac2594c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:38:32.914464 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-9bd9ab21-c40c-4d2a-8193-dc16a695faec tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] 10.222.0.45 "GET /compute/v2.1/servers/4e67b25e-7e65-4975-bafa-fceafcd53647" status: 200 len: 1566 microversion: 2.1 time: 0.382095 Jan 21 09:38:32.915353 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 240/486] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:38:32 2022] GET /compute/v2.1/servers/4e67b25e-7e65-4975-bafa-fceafcd53647 => generated 1566 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:38:32.920025 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-7b4c22d5-f62e-45d1-9a7f-4d9a5e9d294e tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:38:32.920859 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-7b4c22d5-f62e-45d1-9a7f-4d9a5e9d294e tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] [instance: 0f393a36-e048-4228-a48c-9ed725c3e71c] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:38:32.928943 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-7b4c22d5-f62e-45d1-9a7f-4d9a5e9d294e tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:32.929672 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-7b4c22d5-f62e-45d1-9a7f-4d9a5e9d294e tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:32.930655 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-7b4c22d5-f62e-45d1-9a7f-4d9a5e9d294e tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:32.931254 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-7b4c22d5-f62e-45d1-9a7f-4d9a5e9d294e tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:33.075974 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-7b4c22d5-f62e-45d1-9a7f-4d9a5e9d294e tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7b2c14d9444d65ab7a874e749671bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3390729231b409e9a83376b428c1a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:38:33.084205 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-7b4c22d5-f62e-45d1-9a7f-4d9a5e9d294e tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] 10.222.0.45 "GET /compute/v2.1/servers/0f393a36-e048-4228-a48c-9ed725c3e71c" status: 200 len: 1318 microversion: 2.1 time: 0.167019 Jan 21 09:38:33.087763 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 241/487] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:38:32 2022] GET /compute/v2.1/servers/0f393a36-e048-4228-a48c-9ed725c3e71c => generated 1318 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:38:33.093042 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-59d21c96-d039-43e0-8748-f4381149694d tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:38:33.094204 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-59d21c96-d039-43e0-8748-f4381149694d tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] [instance: 59ad64a5-af93-44ef-8031-fd2f2d18a901] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:38:33.100032 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-59d21c96-d039-43e0-8748-f4381149694d tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:33.100543 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-59d21c96-d039-43e0-8748-f4381149694d tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:33.101365 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-59d21c96-d039-43e0-8748-f4381149694d tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:33.101799 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-59d21c96-d039-43e0-8748-f4381149694d tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:33.317496 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-59d21c96-d039-43e0-8748-f4381149694d tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:38:33.326031 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-59d21c96-d039-43e0-8748-f4381149694d tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:38:33.332390 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-59d21c96-d039-43e0-8748-f4381149694d tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:38:33.343405 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-59d21c96-d039-43e0-8748-f4381149694d tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "GET /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901" status: 200 len: 1739 microversion: 2.20 time: 0.251126 Jan 21 09:38:33.345851 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 242/488] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jan 21 09:38:33 2022] GET /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901 => generated 1739 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 21 09:38:33.359908 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-a744f83f-6b86-4bf8-a1ad-60a45ec1500e tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:38:33.362678 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-a744f83f-6b86-4bf8-a1ad-60a45ec1500e tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] [instance: a4e4d869-a178-4acd-8305-895d478f77ce] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:38:33.377380 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-a744f83f-6b86-4bf8-a1ad-60a45ec1500e tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:33.377913 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-a744f83f-6b86-4bf8-a1ad-60a45ec1500e tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:33.378649 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-a744f83f-6b86-4bf8-a1ad-60a45ec1500e tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:33.379052 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-a744f83f-6b86-4bf8-a1ad-60a45ec1500e tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:33.726740 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-a744f83f-6b86-4bf8-a1ad-60a45ec1500e tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7233857fe3a341b78e6449904cd935bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1d230932114019a989885b46cb9283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:38:33.735322 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-a744f83f-6b86-4bf8-a1ad-60a45ec1500e tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] 10.222.0.45 "GET /compute/v2.1/servers/a4e4d869-a178-4acd-8305-895d478f77ce" status: 200 len: 1312 microversion: 2.1 time: 0.386392 Jan 21 09:38:33.740687 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 243/489] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:38:33 2022] GET /compute/v2.1/servers/a4e4d869-a178-4acd-8305-895d478f77ce => generated 1312 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:38:33.752224 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-bb157ce5-36d6-4b9e-ae2c-d064c30ff829 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:38:33.768848 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-bb157ce5-36d6-4b9e-ae2c-d064c30ff829 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] [instance: 750f8ae5-b267-4b76-bb13-170071722932] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:38:33.782503 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-bb157ce5-36d6-4b9e-ae2c-d064c30ff829 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:33.782942 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-bb157ce5-36d6-4b9e-ae2c-d064c30ff829 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:33.795118 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-bb157ce5-36d6-4b9e-ae2c-d064c30ff829 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:33.795792 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-bb157ce5-36d6-4b9e-ae2c-d064c30ff829 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:34.106993 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-bb157ce5-36d6-4b9e-ae2c-d064c30ff829 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a8838f167743678110ca0a9d5a2484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10ed49573f464cc18794b94fd1c115ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:38:34.118230 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-bb157ce5-36d6-4b9e-ae2c-d064c30ff829 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] 10.222.0.45 "GET /compute/v2.1/servers/750f8ae5-b267-4b76-bb13-170071722932" status: 200 len: 1357 microversion: 2.1 time: 0.380762 Jan 21 09:38:34.120291 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 244/490] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:38:33 2022] GET /compute/v2.1/servers/750f8ae5-b267-4b76-bb13-170071722932 => generated 1357 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:38:34.126046 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [req-058c37bf-0b0d-4221-9e94-eb7b082e32b9 req-e1e52a26-dd67-4dd0-a5f9-2b019f3f02f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4e4d869-a178-4acd-8305-895d478f77ce", "name": "network-vif-plugged", "status": "completed", "tag": "c37f8b48-fdff-490a-a961-319445aac8a3"}]} {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:38:34.129292 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 21 09:38:34.129292 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: warnings.warn(msg) Jan 21 09:38:34.141438 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [req-058c37bf-0b0d-4221-9e94-eb7b082e32b9 req-e1e52a26-dd67-4dd0-a5f9-2b019f3f02f2 service nova] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:34.142196 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [req-058c37bf-0b0d-4221-9e94-eb7b082e32b9 req-e1e52a26-dd67-4dd0-a5f9-2b019f3f02f2 service nova] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:34.161219 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.compute.server_external_events [req-058c37bf-0b0d-4221-9e94-eb7b082e32b9 req-e1e52a26-dd67-4dd0-a5f9-2b019f3f02f2 service nova] Creating event network-vif-plugged:c37f8b48-fdff-490a-a961-319445aac8a3 for instance a4e4d869-a178-4acd-8305-895d478f77ce on hv-cinder-80403 Jan 21 09:38:34.174127 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [req-058c37bf-0b0d-4221-9e94-eb7b082e32b9 req-e1e52a26-dd67-4dd0-a5f9-2b019f3f02f2 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050126 Jan 21 09:38:34.175764 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 245/491] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Jan 21 09:38:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 09:38:34.183385 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-91628063-b465-4454-8dd0-7d879a62a7ca tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:38:34.184435 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-91628063-b465-4454-8dd0-7d879a62a7ca tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] [instance: 4e67b25e-7e65-4975-bafa-fceafcd53647] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:38:34.193782 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-91628063-b465-4454-8dd0-7d879a62a7ca tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:34.194530 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-91628063-b465-4454-8dd0-7d879a62a7ca tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:34.195872 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-91628063-b465-4454-8dd0-7d879a62a7ca tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:34.196481 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-91628063-b465-4454-8dd0-7d879a62a7ca tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:34.395509 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-91628063-b465-4454-8dd0-7d879a62a7ca tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db87258db1424ce7a8399fdd05efe3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89d1b21ad8471a8a9a82adac2594c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:38:34.403641 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-91628063-b465-4454-8dd0-7d879a62a7ca tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] 10.222.0.45 "GET /compute/v2.1/servers/4e67b25e-7e65-4975-bafa-fceafcd53647" status: 200 len: 1566 microversion: 2.1 time: 0.226386 Jan 21 09:38:34.404133 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 246/492] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:38:34 2022] GET /compute/v2.1/servers/4e67b25e-7e65-4975-bafa-fceafcd53647 => generated 1566 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:38:34.408420 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-a2d9ca4d-2687-45c6-ab1b-2f525c5608c2 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:38:34.409952 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-a2d9ca4d-2687-45c6-ab1b-2f525c5608c2 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] [instance: 0f393a36-e048-4228-a48c-9ed725c3e71c] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:38:34.416208 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-a2d9ca4d-2687-45c6-ab1b-2f525c5608c2 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:34.416661 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-a2d9ca4d-2687-45c6-ab1b-2f525c5608c2 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:34.417492 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-a2d9ca4d-2687-45c6-ab1b-2f525c5608c2 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:34.417937 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-a2d9ca4d-2687-45c6-ab1b-2f525c5608c2 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:34.593893 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-a2d9ca4d-2687-45c6-ab1b-2f525c5608c2 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7b2c14d9444d65ab7a874e749671bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3390729231b409e9a83376b428c1a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:38:34.602743 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-a2d9ca4d-2687-45c6-ab1b-2f525c5608c2 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] 10.222.0.45 "GET /compute/v2.1/servers/0f393a36-e048-4228-a48c-9ed725c3e71c" status: 200 len: 1508 microversion: 2.1 time: 0.197543 Jan 21 09:38:34.603384 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 247/493] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:38:34 2022] GET /compute/v2.1/servers/0f393a36-e048-4228-a48c-9ed725c3e71c => generated 1508 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:38:34.607633 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-831a66b5-e4fe-45fb-86a9-0229f7120c8f tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:38:34.608226 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-831a66b5-e4fe-45fb-86a9-0229f7120c8f tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] [instance: 59ad64a5-af93-44ef-8031-fd2f2d18a901] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:38:34.624666 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-831a66b5-e4fe-45fb-86a9-0229f7120c8f tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:34.625341 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-831a66b5-e4fe-45fb-86a9-0229f7120c8f tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:34.626775 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-831a66b5-e4fe-45fb-86a9-0229f7120c8f tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:34.627252 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-831a66b5-e4fe-45fb-86a9-0229f7120c8f tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:35.081225 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-831a66b5-e4fe-45fb-86a9-0229f7120c8f tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:38:35.097293 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-831a66b5-e4fe-45fb-86a9-0229f7120c8f tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:38:35.103106 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-831a66b5-e4fe-45fb-86a9-0229f7120c8f tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:38:35.119926 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-831a66b5-e4fe-45fb-86a9-0229f7120c8f tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "GET /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901" status: 200 len: 1739 microversion: 2.20 time: 0.502410 Jan 21 09:38:35.121332 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 248/494] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jan 21 09:38:34 2022] GET /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901 => generated 1739 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 21 09:38:35.126254 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-773d4344-4346-42de-880e-90fdf58b0396 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:38:35.127257 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-773d4344-4346-42de-880e-90fdf58b0396 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] [instance: a4e4d869-a178-4acd-8305-895d478f77ce] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:38:35.138692 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-773d4344-4346-42de-880e-90fdf58b0396 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:35.139574 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-773d4344-4346-42de-880e-90fdf58b0396 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:35.141956 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-773d4344-4346-42de-880e-90fdf58b0396 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:35.142657 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-773d4344-4346-42de-880e-90fdf58b0396 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:35.414749 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.network.neutron [None req-c3aa25fb-a381-4fd6-b746-32873545edc8 tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] validate_networks() for [('7ccd0197-ed42-4d03-8ffc-af304fe19f70', None, None, None, None, None)] {{(pid=123387) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 21 09:38:35.507308 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-773d4344-4346-42de-880e-90fdf58b0396 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7233857fe3a341b78e6449904cd935bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1d230932114019a989885b46cb9283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:38:35.515172 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-773d4344-4346-42de-880e-90fdf58b0396 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] 10.222.0.45 "GET /compute/v2.1/servers/a4e4d869-a178-4acd-8305-895d478f77ce" status: 200 len: 1312 microversion: 2.1 time: 0.392350 Jan 21 09:38:35.529847 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 249/495] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:38:35 2022] GET /compute/v2.1/servers/a4e4d869-a178-4acd-8305-895d478f77ce => generated 1312 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:38:35.546008 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-763c6546-0ea3-4039-9457-3554ad402c62 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:38:35.546649 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-763c6546-0ea3-4039-9457-3554ad402c62 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] [instance: 750f8ae5-b267-4b76-bb13-170071722932] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:38:35.560948 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-763c6546-0ea3-4039-9457-3554ad402c62 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:35.561564 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-763c6546-0ea3-4039-9457-3554ad402c62 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:35.562527 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-763c6546-0ea3-4039-9457-3554ad402c62 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:35.563493 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-763c6546-0ea3-4039-9457-3554ad402c62 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:35.861896 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-763c6546-0ea3-4039-9457-3554ad402c62 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a8838f167743678110ca0a9d5a2484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10ed49573f464cc18794b94fd1c115ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:38:35.870355 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-763c6546-0ea3-4039-9457-3554ad402c62 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] 10.222.0.45 "GET /compute/v2.1/servers/750f8ae5-b267-4b76-bb13-170071722932" status: 200 len: 1357 microversion: 2.1 time: 0.339335 Jan 21 09:38:35.880884 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 250/496] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:38:35 2022] GET /compute/v2.1/servers/750f8ae5-b267-4b76-bb13-170071722932 => generated 1357 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:38:35.880884 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-a26732b3-5a1f-439a-9b46-6a6fa882ccf0 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:38:35.880884 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-a26732b3-5a1f-439a-9b46-6a6fa882ccf0 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] [instance: 4e67b25e-7e65-4975-bafa-fceafcd53647] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:38:35.887294 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-a26732b3-5a1f-439a-9b46-6a6fa882ccf0 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:35.887748 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-a26732b3-5a1f-439a-9b46-6a6fa882ccf0 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:35.888584 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-a26732b3-5a1f-439a-9b46-6a6fa882ccf0 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:35.889046 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-a26732b3-5a1f-439a-9b46-6a6fa882ccf0 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:36.109540 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-a26732b3-5a1f-439a-9b46-6a6fa882ccf0 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db87258db1424ce7a8399fdd05efe3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89d1b21ad8471a8a9a82adac2594c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:38:36.119005 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-a26732b3-5a1f-439a-9b46-6a6fa882ccf0 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] 10.222.0.45 "GET /compute/v2.1/servers/4e67b25e-7e65-4975-bafa-fceafcd53647" status: 200 len: 1566 microversion: 2.1 time: 0.245552 Jan 21 09:38:36.119803 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 251/497] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:38:35 2022] GET /compute/v2.1/servers/4e67b25e-7e65-4975-bafa-fceafcd53647 => generated 1566 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:38:36.123077 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.virt.hardware [None req-c3aa25fb-a381-4fd6-b746-32873545edc8 tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Flavor limits 0:0:0 {{(pid=123387) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 21 09:38:36.123564 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.virt.hardware [None req-c3aa25fb-a381-4fd6-b746-32873545edc8 tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Image limits 0:0:0 {{(pid=123387) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 21 09:38:36.124032 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.virt.hardware [None req-c3aa25fb-a381-4fd6-b746-32873545edc8 tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Flavor pref 0:0:0 {{(pid=123387) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 21 09:38:36.124429 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.virt.hardware [None req-c3aa25fb-a381-4fd6-b746-32873545edc8 tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Image pref 0:0:0 {{(pid=123387) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 21 09:38:36.125438 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.virt.hardware [None req-c3aa25fb-a381-4fd6-b746-32873545edc8 tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123387) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 21 09:38:36.134967 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-c3aa25fb-a381-4fd6-b746-32873545edc8 tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:36.135452 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-c3aa25fb-a381-4fd6-b746-32873545edc8 tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:36.136279 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-c3aa25fb-a381-4fd6-b746-32873545edc8 tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:36.136680 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-c3aa25fb-a381-4fd6-b746-32873545edc8 tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:36.155071 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.quota [None req-c3aa25fb-a381-4fd6-b746-32873545edc8 tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Getting quotas for project 5db07feb3a43432999da539b6b85fb2a. Resources: {'cores', 'instances', 'ram'} {{(pid=123387) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 21 09:38:36.159605 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.quota [None req-c3aa25fb-a381-4fd6-b746-32873545edc8 tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Getting quotas for user 498146f6a6814129b393e7084057bfd0 and project 5db07feb3a43432999da539b6b85fb2a. Resources: {'cores', 'instances', 'ram'} {{(pid=123387) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 21 09:38:36.171540 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-c3aa25fb-a381-4fd6-b746-32873545edc8 tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Going to run 1 instances... {{(pid=123387) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 21 09:38:36.173798 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-c3aa25fb-a381-4fd6-b746-32873545edc8 tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] [instance: 6104a6dc-afee-486a-a867-490dad16c883] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='813e53ee-82e7-4a13-9f63-a8be7b1089f1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123387) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 21 09:38:36.339443 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-c3aa25fb-a381-4fd6-b746-32873545edc8 tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 10.718066 Jan 21 09:38:36.340608 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 247/498] 10.222.0.45 () {60 vars in 1146 bytes} [Fri Jan 21 09:38:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 10720 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 21 09:38:36.345346 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-bd5c3f1a-13a4-49fc-b157-1950d58680c3 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:38:36.346343 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-bd5c3f1a-13a4-49fc-b157-1950d58680c3 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] [instance: 59ad64a5-af93-44ef-8031-fd2f2d18a901] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:38:36.352872 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-bd5c3f1a-13a4-49fc-b157-1950d58680c3 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:36.353610 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-bd5c3f1a-13a4-49fc-b157-1950d58680c3 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:36.357749 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-bd5c3f1a-13a4-49fc-b157-1950d58680c3 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:36.357749 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-bd5c3f1a-13a4-49fc-b157-1950d58680c3 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:36.386504 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-474b3fe1-cc78-46ed-9a65-8bee1341854b tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Action: 'create', calling method: .version_select at 0x7fb6c355ba60>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-772796190"}} {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:38:36.416866 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.quota [None req-474b3fe1-cc78-46ed-9a65-8bee1341854b tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Getting quotas for project 515ded26ca114fbf9c6e920362aec64c. Resources: {'key_pairs'} {{(pid=123386) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 21 09:38:36.421945 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.quota [None req-474b3fe1-cc78-46ed-9a65-8bee1341854b tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Getting quotas for user 3d53a7fa2cb5498aa916817b82dba77e and project 515ded26ca114fbf9c6e920362aec64c. Resources: {'key_pairs'} {{(pid=123386) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 21 09:38:36.517765 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-bd5c3f1a-13a4-49fc-b157-1950d58680c3 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:38:36.529970 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-bd5c3f1a-13a4-49fc-b157-1950d58680c3 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:38:36.531770 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-bd5c3f1a-13a4-49fc-b157-1950d58680c3 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:38:36.534788 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-bd5c3f1a-13a4-49fc-b157-1950d58680c3 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "GET /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901" status: 200 len: 1739 microversion: 2.20 time: 0.192819 Jan 21 09:38:36.558974 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 248/499] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jan 21 09:38:36 2022] GET /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901 => generated 1739 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 21 09:38:36.579156 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-52ee639e-cf03-4425-a3b3-538b573b4599 tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:38:36.580427 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-52ee639e-cf03-4425-a3b3-538b573b4599 tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] [instance: 6104a6dc-afee-486a-a867-490dad16c883] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:38:36.652245 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-52ee639e-cf03-4425-a3b3-538b573b4599 tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498146f6a6814129b393e7084057bfd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db07feb3a43432999da539b6b85fb2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:38:36.660540 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-52ee639e-cf03-4425-a3b3-538b573b4599 tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] 10.222.0.45 "GET /compute/v2.1/servers/6104a6dc-afee-486a-a867-490dad16c883" status: 200 len: 1219 microversion: 2.1 time: 0.099430 Jan 21 09:38:36.661133 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 249/500] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:38:36 2022] GET /compute/v2.1/servers/6104a6dc-afee-486a-a867-490dad16c883 => generated 1219 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:38:36.666042 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-1dbc00ac-df6e-4a1c-859c-18d191d68077 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:38:36.670642 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-1dbc00ac-df6e-4a1c-859c-18d191d68077 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] [instance: a4e4d869-a178-4acd-8305-895d478f77ce] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:38:36.673030 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-1dbc00ac-df6e-4a1c-859c-18d191d68077 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:36.673519 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-1dbc00ac-df6e-4a1c-859c-18d191d68077 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:36.675052 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-1dbc00ac-df6e-4a1c-859c-18d191d68077 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:36.675615 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-1dbc00ac-df6e-4a1c-859c-18d191d68077 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:36.731985 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.quota [None req-474b3fe1-cc78-46ed-9a65-8bee1341854b tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Getting quotas for project 515ded26ca114fbf9c6e920362aec64c. Resources: {'key_pairs'} {{(pid=123386) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 21 09:38:36.738695 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.quota [None req-474b3fe1-cc78-46ed-9a65-8bee1341854b tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Getting quotas for user 3d53a7fa2cb5498aa916817b82dba77e and project 515ded26ca114fbf9c6e920362aec64c. Resources: {'key_pairs'} {{(pid=123386) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 21 09:38:36.752004 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-474b3fe1-cc78-46ed-9a65-8bee1341854b tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 2318 microversion: 2.1 time: 0.631000 Jan 21 09:38:36.762740 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 252/501] 10.222.0.45 () {60 vars in 1157 bytes} [Fri Jan 21 09:38:36 2022] POST /compute/v2.1/os-keypairs => generated 2318 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:38:36.762740 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-0db8d7cb-bbec-4f5c-9e1d-43b4c2a353b1 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6f656268-11e5-4bae-b345-c6bf22cdd3c2"}} {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:38:36.762740 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-0db8d7cb-bbec-4f5c-9e1d-43b4c2a353b1 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] [instance: 0f393a36-e048-4228-a48c-9ed725c3e71c] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:38:36.769601 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-0db8d7cb-bbec-4f5c-9e1d-43b4c2a353b1 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:36.770199 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-0db8d7cb-bbec-4f5c-9e1d-43b4c2a353b1 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:36.771192 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-0db8d7cb-bbec-4f5c-9e1d-43b4c2a353b1 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:36.771737 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-0db8d7cb-bbec-4f5c-9e1d-43b4c2a353b1 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:36.950645 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-1dbc00ac-df6e-4a1c-859c-18d191d68077 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7233857fe3a341b78e6449904cd935bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1d230932114019a989885b46cb9283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:38:36.958970 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-1dbc00ac-df6e-4a1c-859c-18d191d68077 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] 10.222.0.45 "GET /compute/v2.1/servers/a4e4d869-a178-4acd-8305-895d478f77ce" status: 200 len: 1312 microversion: 2.1 time: 0.296369 Jan 21 09:38:36.962890 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 250/502] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:38:36 2022] GET /compute/v2.1/servers/a4e4d869-a178-4acd-8305-895d478f77ce => generated 1312 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:38:36.973021 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-566baf9a-9ad4-4625-a9ca-2a82e22776fa tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:38:36.973731 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-566baf9a-9ad4-4625-a9ca-2a82e22776fa tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] [instance: 750f8ae5-b267-4b76-bb13-170071722932] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:38:36.980327 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-566baf9a-9ad4-4625-a9ca-2a82e22776fa tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:36.981073 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-566baf9a-9ad4-4625-a9ca-2a82e22776fa tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:36.984884 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-566baf9a-9ad4-4625-a9ca-2a82e22776fa tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:36.984884 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-566baf9a-9ad4-4625-a9ca-2a82e22776fa tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:37.273668 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-566baf9a-9ad4-4625-a9ca-2a82e22776fa tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a8838f167743678110ca0a9d5a2484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10ed49573f464cc18794b94fd1c115ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:38:37.280810 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-566baf9a-9ad4-4625-a9ca-2a82e22776fa tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] 10.222.0.45 "GET /compute/v2.1/servers/750f8ae5-b267-4b76-bb13-170071722932" status: 200 len: 1357 microversion: 2.1 time: 0.314407 Jan 21 09:38:37.281413 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 251/503] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:38:36 2022] GET /compute/v2.1/servers/750f8ae5-b267-4b76-bb13-170071722932 => generated 1357 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:38:37.288644 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-aa7f805a-038f-4057-b354-9983ba439367 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:38:37.289339 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-aa7f805a-038f-4057-b354-9983ba439367 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] [instance: 4e67b25e-7e65-4975-bafa-fceafcd53647] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:38:37.296488 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-aa7f805a-038f-4057-b354-9983ba439367 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:37.296488 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-aa7f805a-038f-4057-b354-9983ba439367 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:37.296488 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-aa7f805a-038f-4057-b354-9983ba439367 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:37.296883 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-aa7f805a-038f-4057-b354-9983ba439367 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:37.575244 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-aa7f805a-038f-4057-b354-9983ba439367 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db87258db1424ce7a8399fdd05efe3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89d1b21ad8471a8a9a82adac2594c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:38:37.587316 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-aa7f805a-038f-4057-b354-9983ba439367 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] 10.222.0.45 "GET /compute/v2.1/servers/4e67b25e-7e65-4975-bafa-fceafcd53647" status: 200 len: 1566 microversion: 2.1 time: 0.304083 Jan 21 09:38:37.587864 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 252/504] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:38:37 2022] GET /compute/v2.1/servers/4e67b25e-7e65-4975-bafa-fceafcd53647 => generated 1566 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:38:37.592301 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-a5c6283f-b640-4611-b1f1-caa657f7bef8 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:38:37.594654 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-a5c6283f-b640-4611-b1f1-caa657f7bef8 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] [instance: 59ad64a5-af93-44ef-8031-fd2f2d18a901] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:38:37.604222 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-a5c6283f-b640-4611-b1f1-caa657f7bef8 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:37.605844 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-a5c6283f-b640-4611-b1f1-caa657f7bef8 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:37.607557 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-a5c6283f-b640-4611-b1f1-caa657f7bef8 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:37.608230 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-a5c6283f-b640-4611-b1f1-caa657f7bef8 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:37.760934 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-0db8d7cb-bbec-4f5c-9e1d-43b4c2a353b1 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] 10.222.0.45 "POST /compute/v2.1/servers/0f393a36-e048-4228-a48c-9ed725c3e71c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.005313 Jan 21 09:38:37.763297 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 253/505] 10.222.0.45 () {60 vars in 1322 bytes} [Fri Jan 21 09:38:36 2022] POST /compute/v2.1/servers/0f393a36-e048-4228-a48c-9ed725c3e71c/os-volume_attachments => generated 194 bytes in 1008 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 09:38:37.790256 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-2a398a2c-26ff-4913-a5f9-f9eff9dd0980 tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:38:37.793295 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-2a398a2c-26ff-4913-a5f9-f9eff9dd0980 tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] [instance: 6104a6dc-afee-486a-a867-490dad16c883] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:38:37.813040 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-2a398a2c-26ff-4913-a5f9-f9eff9dd0980 tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:37.814537 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-2a398a2c-26ff-4913-a5f9-f9eff9dd0980 tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:37.816085 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-2a398a2c-26ff-4913-a5f9-f9eff9dd0980 tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:37.816541 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-2a398a2c-26ff-4913-a5f9-f9eff9dd0980 tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:37.830060 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-a5c6283f-b640-4611-b1f1-caa657f7bef8 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:38:37.848785 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-a5c6283f-b640-4611-b1f1-caa657f7bef8 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:38:37.863770 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-a5c6283f-b640-4611-b1f1-caa657f7bef8 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:38:37.867378 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-a5c6283f-b640-4611-b1f1-caa657f7bef8 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "GET /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901" status: 200 len: 1721 microversion: 2.20 time: 0.278038 Jan 21 09:38:37.869893 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 253/506] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jan 21 09:38:37 2022] GET /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901 => generated 1721 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 21 09:38:37.935074 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-2a398a2c-26ff-4913-a5f9-f9eff9dd0980 tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498146f6a6814129b393e7084057bfd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db07feb3a43432999da539b6b85fb2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:38:37.943703 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-2a398a2c-26ff-4913-a5f9-f9eff9dd0980 tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] 10.222.0.45 "GET /compute/v2.1/servers/6104a6dc-afee-486a-a867-490dad16c883" status: 200 len: 1215 microversion: 2.1 time: 0.178796 Jan 21 09:38:37.945532 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 254/507] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:38:37 2022] GET /compute/v2.1/servers/6104a6dc-afee-486a-a867-490dad16c883 => generated 1215 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:38:37.979626 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-c00d9623-b715-477f-a9a7-1455b49b4ff9 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:38:37.980575 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-c00d9623-b715-477f-a9a7-1455b49b4ff9 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] [instance: a4e4d869-a178-4acd-8305-895d478f77ce] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:38:37.989282 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-c00d9623-b715-477f-a9a7-1455b49b4ff9 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:37.990284 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-c00d9623-b715-477f-a9a7-1455b49b4ff9 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:37.991335 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-c00d9623-b715-477f-a9a7-1455b49b4ff9 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:37.992995 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-c00d9623-b715-477f-a9a7-1455b49b4ff9 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:38.169350 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-c00d9623-b715-477f-a9a7-1455b49b4ff9 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7233857fe3a341b78e6449904cd935bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1d230932114019a989885b46cb9283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:38:38.178098 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-c00d9623-b715-477f-a9a7-1455b49b4ff9 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] 10.222.0.45 "GET /compute/v2.1/servers/a4e4d869-a178-4acd-8305-895d478f77ce" status: 200 len: 1497 microversion: 2.1 time: 0.202106 Jan 21 09:38:38.179642 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 254/508] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:38:37 2022] GET /compute/v2.1/servers/a4e4d869-a178-4acd-8305-895d478f77ce => generated 1497 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:38:38.297733 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-c5532f48-380c-4948-bf0b-7e94abadd1ce tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:38:38.298770 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-c5532f48-380c-4948-bf0b-7e94abadd1ce tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] [instance: 750f8ae5-b267-4b76-bb13-170071722932] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:38:38.306443 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-c5532f48-380c-4948-bf0b-7e94abadd1ce tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:38.307144 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-c5532f48-380c-4948-bf0b-7e94abadd1ce tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:38.310635 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-c5532f48-380c-4948-bf0b-7e94abadd1ce tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:38.310635 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-c5532f48-380c-4948-bf0b-7e94abadd1ce tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:38.476258 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-c5532f48-380c-4948-bf0b-7e94abadd1ce tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a8838f167743678110ca0a9d5a2484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10ed49573f464cc18794b94fd1c115ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:38:38.484640 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-c5532f48-380c-4948-bf0b-7e94abadd1ce tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] 10.222.0.45 "GET /compute/v2.1/servers/750f8ae5-b267-4b76-bb13-170071722932" status: 200 len: 1357 microversion: 2.1 time: 0.191544 Jan 21 09:38:38.485231 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 255/509] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:38:38 2022] GET /compute/v2.1/servers/750f8ae5-b267-4b76-bb13-170071722932 => generated 1357 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:38:38.613189 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-a81e8716-dc46-4491-adc3-285962b5e85d tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:38:38.614763 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-a81e8716-dc46-4491-adc3-285962b5e85d tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] [instance: 4e67b25e-7e65-4975-bafa-fceafcd53647] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:38:38.648223 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-a81e8716-dc46-4491-adc3-285962b5e85d tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:38.648678 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-a81e8716-dc46-4491-adc3-285962b5e85d tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:38.649527 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-a81e8716-dc46-4491-adc3-285962b5e85d tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:38.649956 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-a81e8716-dc46-4491-adc3-285962b5e85d tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:38.854949 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-a81e8716-dc46-4491-adc3-285962b5e85d tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db87258db1424ce7a8399fdd05efe3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89d1b21ad8471a8a9a82adac2594c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:38:38.879779 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-a81e8716-dc46-4491-adc3-285962b5e85d tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] 10.222.0.45 "GET /compute/v2.1/servers/4e67b25e-7e65-4975-bafa-fceafcd53647" status: 200 len: 1566 microversion: 2.1 time: 0.277580 Jan 21 09:38:38.881300 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 255/510] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:38:38 2022] GET /compute/v2.1/servers/4e67b25e-7e65-4975-bafa-fceafcd53647 => generated 1566 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:38:38.896394 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-1cdc8690-d929-4b9b-bc66-73483790c003 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:38:38.898134 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-1cdc8690-d929-4b9b-bc66-73483790c003 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] [instance: 59ad64a5-af93-44ef-8031-fd2f2d18a901] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:38:38.941535 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-1cdc8690-d929-4b9b-bc66-73483790c003 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.035s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:38.943043 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-1cdc8690-d929-4b9b-bc66-73483790c003 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:38.945760 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-1cdc8690-d929-4b9b-bc66-73483790c003 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:38.949391 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-1cdc8690-d929-4b9b-bc66-73483790c003 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:38.976110 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-e80c8832-80bb-417f-848b-b3615c75405b tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:38:38.976751 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-e80c8832-80bb-417f-848b-b3615c75405b tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] [instance: 6104a6dc-afee-486a-a867-490dad16c883] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:38:38.983296 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-e80c8832-80bb-417f-848b-b3615c75405b tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:38.984275 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-e80c8832-80bb-417f-848b-b3615c75405b tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:38.985571 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-e80c8832-80bb-417f-848b-b3615c75405b tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:38.986651 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-e80c8832-80bb-417f-848b-b3615c75405b tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:39.116039 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-e80c8832-80bb-417f-848b-b3615c75405b tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498146f6a6814129b393e7084057bfd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db07feb3a43432999da539b6b85fb2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:38:39.141519 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-e80c8832-80bb-417f-848b-b3615c75405b tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] 10.222.0.45 "GET /compute/v2.1/servers/6104a6dc-afee-486a-a867-490dad16c883" status: 200 len: 1279 microversion: 2.1 time: 0.182449 Jan 21 09:38:39.142158 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 256/511] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:38:38 2022] GET /compute/v2.1/servers/6104a6dc-afee-486a-a867-490dad16c883 => generated 1279 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 09:38:39.190922 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-1c41f716-7a6b-42ee-928e-ef772d14c817 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:38:39.192207 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-1c41f716-7a6b-42ee-928e-ef772d14c817 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] [instance: a4e4d869-a178-4acd-8305-895d478f77ce] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:38:39.210566 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-1c41f716-7a6b-42ee-928e-ef772d14c817 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:39.211400 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-1c41f716-7a6b-42ee-928e-ef772d14c817 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:39.212644 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-1c41f716-7a6b-42ee-928e-ef772d14c817 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:39.213100 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-1c41f716-7a6b-42ee-928e-ef772d14c817 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:39.245067 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-1c41f716-7a6b-42ee-928e-ef772d14c817 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] [instance: a4e4d869-a178-4acd-8305-895d478f77ce] Going to try to terminate instance {{(pid=123387) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 21 09:38:39.325399 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-1cdc8690-d929-4b9b-bc66-73483790c003 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:38:39.364911 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-1cdc8690-d929-4b9b-bc66-73483790c003 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:38:39.367953 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-1cdc8690-d929-4b9b-bc66-73483790c003 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:38:39.370278 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-1cdc8690-d929-4b9b-bc66-73483790c003 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "GET /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901" status: 200 len: 1721 microversion: 2.20 time: 0.477351 Jan 21 09:38:39.371768 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 256/512] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jan 21 09:38:38 2022] GET /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901 => generated 1721 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 21 09:38:39.501594 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-20b801fe-bca6-4440-874b-ac61bfa18a93 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:38:39.502742 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-20b801fe-bca6-4440-874b-ac61bfa18a93 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] [instance: 750f8ae5-b267-4b76-bb13-170071722932] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:38:39.518980 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-20b801fe-bca6-4440-874b-ac61bfa18a93 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:39.518980 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-20b801fe-bca6-4440-874b-ac61bfa18a93 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:39.525612 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-20b801fe-bca6-4440-874b-ac61bfa18a93 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:39.526383 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-20b801fe-bca6-4440-874b-ac61bfa18a93 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:39.682323 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-1c41f716-7a6b-42ee-928e-ef772d14c817 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] 10.222.0.45 "DELETE /compute/v2.1/servers/a4e4d869-a178-4acd-8305-895d478f77ce" status: 204 len: 0 microversion: 2.1 time: 0.502637 Jan 21 09:38:39.683902 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 257/513] 10.222.0.45 () {58 vars in 1238 bytes} [Fri Jan 21 09:38:39 2022] DELETE /compute/v2.1/servers/a4e4d869-a178-4acd-8305-895d478f77ce => generated 0 bytes in 506 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 21 09:38:39.695948 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-ece8e541-6900-4ad9-b074-a900f9961053 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:38:39.696835 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-ece8e541-6900-4ad9-b074-a900f9961053 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] [instance: a4e4d869-a178-4acd-8305-895d478f77ce] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:38:39.707099 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-ece8e541-6900-4ad9-b074-a900f9961053 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:39.707610 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-ece8e541-6900-4ad9-b074-a900f9961053 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:39.708491 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-ece8e541-6900-4ad9-b074-a900f9961053 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:39.708934 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-ece8e541-6900-4ad9-b074-a900f9961053 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:39.841386 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-20b801fe-bca6-4440-874b-ac61bfa18a93 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a8838f167743678110ca0a9d5a2484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10ed49573f464cc18794b94fd1c115ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:38:39.857761 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-20b801fe-bca6-4440-874b-ac61bfa18a93 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] 10.222.0.45 "GET /compute/v2.1/servers/750f8ae5-b267-4b76-bb13-170071722932" status: 200 len: 1357 microversion: 2.1 time: 0.359629 Jan 21 09:38:39.858356 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 257/514] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:38:39 2022] GET /compute/v2.1/servers/750f8ae5-b267-4b76-bb13-170071722932 => generated 1357 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 09:38:39.900837 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-f58a15d4-5bda-412b-8586-1bd825d7096c tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:38:39.901658 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-f58a15d4-5bda-412b-8586-1bd825d7096c tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] [instance: 4e67b25e-7e65-4975-bafa-fceafcd53647] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:38:39.908609 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-f58a15d4-5bda-412b-8586-1bd825d7096c tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:39.910213 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-f58a15d4-5bda-412b-8586-1bd825d7096c tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:39.912658 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-f58a15d4-5bda-412b-8586-1bd825d7096c tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:39.913336 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-f58a15d4-5bda-412b-8586-1bd825d7096c tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:40.072589 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-ece8e541-6900-4ad9-b074-a900f9961053 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7233857fe3a341b78e6449904cd935bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1d230932114019a989885b46cb9283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:38:40.084105 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-ece8e541-6900-4ad9-b074-a900f9961053 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] 10.222.0.45 "GET /compute/v2.1/servers/a4e4d869-a178-4acd-8305-895d478f77ce" status: 200 len: 1503 microversion: 2.1 time: 0.395178 Jan 21 09:38:40.091301 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 258/515] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:38:39 2022] GET /compute/v2.1/servers/a4e4d869-a178-4acd-8305-895d478f77ce => generated 1503 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:38:40.165596 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-17b7572c-cf39-44d2-9c36-427f7d77362b tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:38:40.166450 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-17b7572c-cf39-44d2-9c36-427f7d77362b tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] [instance: 6104a6dc-afee-486a-a867-490dad16c883] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:38:40.184705 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-17b7572c-cf39-44d2-9c36-427f7d77362b tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:40.190631 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-17b7572c-cf39-44d2-9c36-427f7d77362b tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:40.190631 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-17b7572c-cf39-44d2-9c36-427f7d77362b tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:40.190631 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-17b7572c-cf39-44d2-9c36-427f7d77362b tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:40.301818 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-17b7572c-cf39-44d2-9c36-427f7d77362b tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498146f6a6814129b393e7084057bfd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db07feb3a43432999da539b6b85fb2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:38:40.304799 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-f58a15d4-5bda-412b-8586-1bd825d7096c tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db87258db1424ce7a8399fdd05efe3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89d1b21ad8471a8a9a82adac2594c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:38:40.310420 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-17b7572c-cf39-44d2-9c36-427f7d77362b tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] 10.222.0.45 "GET /compute/v2.1/servers/6104a6dc-afee-486a-a867-490dad16c883" status: 200 len: 1277 microversion: 2.1 time: 0.148506 Jan 21 09:38:40.311423 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 259/516] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:38:40 2022] GET /compute/v2.1/servers/6104a6dc-afee-486a-a867-490dad16c883 => generated 1277 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:38:40.325606 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-f58a15d4-5bda-412b-8586-1bd825d7096c tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] 10.222.0.45 "GET /compute/v2.1/servers/4e67b25e-7e65-4975-bafa-fceafcd53647" status: 200 len: 1566 microversion: 2.1 time: 0.428233 Jan 21 09:38:40.335145 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 258/517] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:38:39 2022] GET /compute/v2.1/servers/4e67b25e-7e65-4975-bafa-fceafcd53647 => generated 1566 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:38:40.397086 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-e27aff8b-6f09-4dac-a923-2421000df8ae tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:38:40.397806 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-e27aff8b-6f09-4dac-a923-2421000df8ae tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] [instance: 59ad64a5-af93-44ef-8031-fd2f2d18a901] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:38:40.405461 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-e27aff8b-6f09-4dac-a923-2421000df8ae tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:40.406686 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-e27aff8b-6f09-4dac-a923-2421000df8ae tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:40.407522 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-e27aff8b-6f09-4dac-a923-2421000df8ae tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:40.407967 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-e27aff8b-6f09-4dac-a923-2421000df8ae tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:40.650437 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-e27aff8b-6f09-4dac-a923-2421000df8ae tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:38:40.663985 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-e27aff8b-6f09-4dac-a923-2421000df8ae tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:38:40.665557 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-e27aff8b-6f09-4dac-a923-2421000df8ae tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:38:40.667319 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-e27aff8b-6f09-4dac-a923-2421000df8ae tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "GET /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901" status: 200 len: 1724 microversion: 2.20 time: 0.275457 Jan 21 09:38:40.668108 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 260/518] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jan 21 09:38:40 2022] GET /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901 => generated 1724 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 21 09:38:40.686444 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-b55c73fa-77a0-4bb1-90e2-d1a5dbe1af25 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0d05e46e-c117-47fd-a511-eb6143bd8e2d"}} {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:38:40.687912 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-b55c73fa-77a0-4bb1-90e2-d1a5dbe1af25 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] [instance: 59ad64a5-af93-44ef-8031-fd2f2d18a901] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:38:40.695013 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-b55c73fa-77a0-4bb1-90e2-d1a5dbe1af25 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:40.695468 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-b55c73fa-77a0-4bb1-90e2-d1a5dbe1af25 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:40.696292 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-b55c73fa-77a0-4bb1-90e2-d1a5dbe1af25 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:40.696968 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-b55c73fa-77a0-4bb1-90e2-d1a5dbe1af25 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:40.881056 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-b34b1164-78e1-4e5a-afd0-abfdcf9f6fa3 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:38:40.881837 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-b34b1164-78e1-4e5a-afd0-abfdcf9f6fa3 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] [instance: 750f8ae5-b267-4b76-bb13-170071722932] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:38:40.889277 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-b34b1164-78e1-4e5a-afd0-abfdcf9f6fa3 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:40.893352 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-b34b1164-78e1-4e5a-afd0-abfdcf9f6fa3 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:40.893352 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-b34b1164-78e1-4e5a-afd0-abfdcf9f6fa3 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:40.893352 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-b34b1164-78e1-4e5a-afd0-abfdcf9f6fa3 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:41.114478 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-b34b1164-78e1-4e5a-afd0-abfdcf9f6fa3 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a8838f167743678110ca0a9d5a2484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10ed49573f464cc18794b94fd1c115ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:38:41.122441 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-b34b1164-78e1-4e5a-afd0-abfdcf9f6fa3 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] 10.222.0.45 "GET /compute/v2.1/servers/750f8ae5-b267-4b76-bb13-170071722932" status: 200 len: 1357 microversion: 2.1 time: 0.246222 Jan 21 09:38:41.123573 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 261/519] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:38:40 2022] GET /compute/v2.1/servers/750f8ae5-b267-4b76-bb13-170071722932 => generated 1357 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 09:38:41.128982 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [req-4fba942e-f25c-44e9-9aba-20a78a394062 req-a066d16c-37ec-4991-9b15-9e710fc281dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59ad64a5-af93-44ef-8031-fd2f2d18a901", "name": "network-vif-unplugged", "status": "completed", "tag": "63990fa3-fce3-4891-adb2-cd4ebc4c075a"}]} {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:38:41.130831 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 21 09:38:41.130831 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: warnings.warn(msg) Jan 21 09:38:41.138264 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [req-4fba942e-f25c-44e9-9aba-20a78a394062 req-a066d16c-37ec-4991-9b15-9e710fc281dc service nova] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:41.139067 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [req-4fba942e-f25c-44e9-9aba-20a78a394062 req-a066d16c-37ec-4991-9b15-9e710fc281dc service nova] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:41.151253 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.compute.server_external_events [req-4fba942e-f25c-44e9-9aba-20a78a394062 req-a066d16c-37ec-4991-9b15-9e710fc281dc service nova] Unable to find a host for instance 59ad64a5-af93-44ef-8031-fd2f2d18a901. Dropping event network-vif-unplugged {{(pid=123387) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Jan 21 09:38:41.152146 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [req-4fba942e-f25c-44e9-9aba-20a78a394062 req-a066d16c-37ec-4991-9b15-9e710fc281dc service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.027427 Jan 21 09:38:41.153012 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 262/520] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Jan 21 09:38:41 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 29 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jan 21 09:38:41.157980 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-a57865a0-e055-4cd0-804b-067781dbc97b tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:38:41.159118 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-a57865a0-e055-4cd0-804b-067781dbc97b tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] [instance: a4e4d869-a178-4acd-8305-895d478f77ce] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:38:41.165393 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-a57865a0-e055-4cd0-804b-067781dbc97b tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:41.165837 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-a57865a0-e055-4cd0-804b-067781dbc97b tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:41.166617 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-a57865a0-e055-4cd0-804b-067781dbc97b tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:41.167043 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-a57865a0-e055-4cd0-804b-067781dbc97b tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:41.692397 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-a57865a0-e055-4cd0-804b-067781dbc97b tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7233857fe3a341b78e6449904cd935bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1d230932114019a989885b46cb9283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:38:41.700651 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-a57865a0-e055-4cd0-804b-067781dbc97b tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] 10.222.0.45 "GET /compute/v2.1/servers/a4e4d869-a178-4acd-8305-895d478f77ce" status: 200 len: 1503 microversion: 2.1 time: 0.546343 Jan 21 09:38:41.707029 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 263/521] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:38:41 2022] GET /compute/v2.1/servers/a4e4d869-a178-4acd-8305-895d478f77ce => generated 1503 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:38:41.712151 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-ae7bbb53-2504-4c3d-9402-e6df75f47730 tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:38:41.712818 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-ae7bbb53-2504-4c3d-9402-e6df75f47730 tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] [instance: 6104a6dc-afee-486a-a867-490dad16c883] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:38:41.718930 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-ae7bbb53-2504-4c3d-9402-e6df75f47730 tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:41.719424 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-ae7bbb53-2504-4c3d-9402-e6df75f47730 tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:41.720177 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-ae7bbb53-2504-4c3d-9402-e6df75f47730 tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:41.720635 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-ae7bbb53-2504-4c3d-9402-e6df75f47730 tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:41.811370 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-b55c73fa-77a0-4bb1-90e2-d1a5dbe1af25 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "POST /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.128972 Jan 21 09:38:41.812374 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 259/522] 10.222.0.45 () {62 vars in 1363 bytes} [Fri Jan 21 09:38:40 2022] POST /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901/os-volume_attachments => generated 188 bytes in 1131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 21 09:38:41.829127 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-f65136bd-abc8-42c6-aadd-cdc235e5c007 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:38:41.831610 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-f65136bd-abc8-42c6-aadd-cdc235e5c007 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] [instance: 4e67b25e-7e65-4975-bafa-fceafcd53647] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:38:41.839811 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-f65136bd-abc8-42c6-aadd-cdc235e5c007 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:41.841884 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-f65136bd-abc8-42c6-aadd-cdc235e5c007 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:41.845188 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-f65136bd-abc8-42c6-aadd-cdc235e5c007 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:41.846944 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-f65136bd-abc8-42c6-aadd-cdc235e5c007 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:42.061372 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-ae7bbb53-2504-4c3d-9402-e6df75f47730 tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498146f6a6814129b393e7084057bfd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db07feb3a43432999da539b6b85fb2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:38:42.070593 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-ae7bbb53-2504-4c3d-9402-e6df75f47730 tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] 10.222.0.45 "GET /compute/v2.1/servers/6104a6dc-afee-486a-a867-490dad16c883" status: 200 len: 1319 microversion: 2.1 time: 0.367576 Jan 21 09:38:42.071564 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 264/523] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:38:41 2022] GET /compute/v2.1/servers/6104a6dc-afee-486a-a867-490dad16c883 => generated 1319 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:38:42.076674 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-7179c841-cc3b-4da4-9eee-06dade559bd1 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:38:42.077813 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-7179c841-cc3b-4da4-9eee-06dade559bd1 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] [instance: 59ad64a5-af93-44ef-8031-fd2f2d18a901] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:38:42.085402 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-7179c841-cc3b-4da4-9eee-06dade559bd1 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:42.085865 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-7179c841-cc3b-4da4-9eee-06dade559bd1 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:42.098606 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-7179c841-cc3b-4da4-9eee-06dade559bd1 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:42.099407 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-7179c841-cc3b-4da4-9eee-06dade559bd1 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:42.302222 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-f65136bd-abc8-42c6-aadd-cdc235e5c007 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db87258db1424ce7a8399fdd05efe3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89d1b21ad8471a8a9a82adac2594c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:38:42.310731 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-f65136bd-abc8-42c6-aadd-cdc235e5c007 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] 10.222.0.45 "GET /compute/v2.1/servers/4e67b25e-7e65-4975-bafa-fceafcd53647" status: 200 len: 1566 microversion: 2.1 time: 0.496762 Jan 21 09:38:42.311319 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 260/524] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:38:41 2022] GET /compute/v2.1/servers/4e67b25e-7e65-4975-bafa-fceafcd53647 => generated 1566 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:38:42.316983 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [req-bddd131a-2c51-4a87-bfe2-3acb8db7cf2e req-396196ff-f57b-4fc8-bd87-85b03684c4fd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6104a6dc-afee-486a-a867-490dad16c883", "tag": "ac7a3142-12ec-4772-8b8e-f317cdd18a45"}]} {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:38:42.318579 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 21 09:38:42.318579 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: warnings.warn(msg) Jan 21 09:38:42.327109 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [req-bddd131a-2c51-4a87-bfe2-3acb8db7cf2e req-396196ff-f57b-4fc8-bd87-85b03684c4fd service nova] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:42.327548 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [req-bddd131a-2c51-4a87-bfe2-3acb8db7cf2e req-396196ff-f57b-4fc8-bd87-85b03684c4fd service nova] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:42.338418 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.compute.server_external_events [req-bddd131a-2c51-4a87-bfe2-3acb8db7cf2e req-396196ff-f57b-4fc8-bd87-85b03684c4fd service nova] Creating event network-changed:ac7a3142-12ec-4772-8b8e-f317cdd18a45 for instance 6104a6dc-afee-486a-a867-490dad16c883 on hv-cinder-80403 Jan 21 09:38:42.343195 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [req-bddd131a-2c51-4a87-bfe2-3acb8db7cf2e req-396196ff-f57b-4fc8-bd87-85b03684c4fd service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030711 Jan 21 09:38:42.343811 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 261/525] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Jan 21 09:38:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 09:38:42.349121 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-d54370f7-e78b-48e0-bce6-4366389c7a94 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:38:42.349842 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-d54370f7-e78b-48e0-bce6-4366389c7a94 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] [instance: 750f8ae5-b267-4b76-bb13-170071722932] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:38:42.356046 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-d54370f7-e78b-48e0-bce6-4366389c7a94 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:42.356494 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-d54370f7-e78b-48e0-bce6-4366389c7a94 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:42.357310 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-d54370f7-e78b-48e0-bce6-4366389c7a94 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:42.357745 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-d54370f7-e78b-48e0-bce6-4366389c7a94 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:42.408041 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-7179c841-cc3b-4da4-9eee-06dade559bd1 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "POST /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901/action" status: 202 len: 0 microversion: 2.20 time: 0.334964 Jan 21 09:38:42.409505 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 265/526] 10.222.0.45 () {62 vars in 1318 bytes} [Fri Jan 21 09:38:42 2022] POST /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901/action => generated 0 bytes in 337 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jan 21 09:38:42.417817 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-cf981459-aabc-464f-8186-52d669a53aaa tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:38:42.418430 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-cf981459-aabc-464f-8186-52d669a53aaa tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] [instance: 59ad64a5-af93-44ef-8031-fd2f2d18a901] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:38:42.425565 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-cf981459-aabc-464f-8186-52d669a53aaa tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:42.426283 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-cf981459-aabc-464f-8186-52d669a53aaa tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:42.427366 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-cf981459-aabc-464f-8186-52d669a53aaa tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:42.427983 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-cf981459-aabc-464f-8186-52d669a53aaa tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:42.865035 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-d54370f7-e78b-48e0-bce6-4366389c7a94 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a8838f167743678110ca0a9d5a2484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10ed49573f464cc18794b94fd1c115ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:38:42.876922 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-d54370f7-e78b-48e0-bce6-4366389c7a94 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] 10.222.0.45 "GET /compute/v2.1/servers/750f8ae5-b267-4b76-bb13-170071722932" status: 200 len: 1357 microversion: 2.1 time: 0.531662 Jan 21 09:38:42.877976 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-cf981459-aabc-464f-8186-52d669a53aaa tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:38:42.879135 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 262/527] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:38:42 2022] GET /compute/v2.1/servers/750f8ae5-b267-4b76-bb13-170071722932 => generated 1357 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:38:42.886333 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-1f285962-281d-4683-b729-bc96ac9ac4d5 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:38:42.887893 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-1f285962-281d-4683-b729-bc96ac9ac4d5 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] [instance: a4e4d869-a178-4acd-8305-895d478f77ce] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:38:42.894779 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-cf981459-aabc-464f-8186-52d669a53aaa tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:38:42.895726 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-1f285962-281d-4683-b729-bc96ac9ac4d5 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:42.896390 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-1f285962-281d-4683-b729-bc96ac9ac4d5 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:42.897412 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-1f285962-281d-4683-b729-bc96ac9ac4d5 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:42.897998 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-1f285962-281d-4683-b729-bc96ac9ac4d5 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:42.901388 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-cf981459-aabc-464f-8186-52d669a53aaa tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:38:42.902649 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-cf981459-aabc-464f-8186-52d669a53aaa tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "GET /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901" status: 200 len: 1750 microversion: 2.20 time: 0.488865 Jan 21 09:38:42.911302 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 266/528] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jan 21 09:38:42 2022] GET /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901 => generated 1750 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 21 09:38:43.010765 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-1f285962-281d-4683-b729-bc96ac9ac4d5 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7233857fe3a341b78e6449904cd935bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e1d230932114019a989885b46cb9283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:38:43.020150 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-1f285962-281d-4683-b729-bc96ac9ac4d5 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] 10.222.0.45 "GET /compute/v2.1/servers/a4e4d869-a178-4acd-8305-895d478f77ce" status: 200 len: 1461 microversion: 2.1 time: 0.139681 Jan 21 09:38:43.020775 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 263/529] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:38:42 2022] GET /compute/v2.1/servers/a4e4d869-a178-4acd-8305-895d478f77ce => generated 1461 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:38:43.087947 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-edd00444-c767-4300-bf5f-06d1a55ef49d tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:38:43.088559 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-edd00444-c767-4300-bf5f-06d1a55ef49d tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] [instance: 6104a6dc-afee-486a-a867-490dad16c883] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:38:43.101619 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-edd00444-c767-4300-bf5f-06d1a55ef49d tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:43.102388 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-edd00444-c767-4300-bf5f-06d1a55ef49d tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:43.103503 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-edd00444-c767-4300-bf5f-06d1a55ef49d tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:43.104107 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-edd00444-c767-4300-bf5f-06d1a55ef49d tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:43.194596 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [req-2d9ba314-773b-4e86-95d2-005e83318589 req-373fc96e-aa93-431e-8903-0f972a915249 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "750f8ae5-b267-4b76-bb13-170071722932", "name": "network-vif-plugged", "status": "completed", "tag": "d22f9cde-e9ce-4b37-9b2a-f673b65a0353"}]} {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:38:43.196391 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 21 09:38:43.196391 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: warnings.warn(msg) Jan 21 09:38:43.211502 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [req-2d9ba314-773b-4e86-95d2-005e83318589 req-373fc96e-aa93-431e-8903-0f972a915249 service nova] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:43.212349 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [req-2d9ba314-773b-4e86-95d2-005e83318589 req-373fc96e-aa93-431e-8903-0f972a915249 service nova] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:43.240783 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.compute.server_external_events [req-2d9ba314-773b-4e86-95d2-005e83318589 req-373fc96e-aa93-431e-8903-0f972a915249 service nova] Creating event network-vif-plugged:d22f9cde-e9ce-4b37-9b2a-f673b65a0353 for instance 750f8ae5-b267-4b76-bb13-170071722932 on hv-cinder-80403 Jan 21 09:38:43.247125 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [req-2d9ba314-773b-4e86-95d2-005e83318589 req-373fc96e-aa93-431e-8903-0f972a915249 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057371 Jan 21 09:38:43.248129 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 264/530] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Jan 21 09:38:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 09:38:43.330556 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-5427c1b7-81f9-4df3-960e-7a91a1f5476d tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:38:43.334998 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-5427c1b7-81f9-4df3-960e-7a91a1f5476d tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] [instance: 4e67b25e-7e65-4975-bafa-fceafcd53647] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:38:43.349039 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-5427c1b7-81f9-4df3-960e-7a91a1f5476d tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:43.349551 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-5427c1b7-81f9-4df3-960e-7a91a1f5476d tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:43.350363 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-5427c1b7-81f9-4df3-960e-7a91a1f5476d tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:43.350800 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-5427c1b7-81f9-4df3-960e-7a91a1f5476d tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:43.452414 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-edd00444-c767-4300-bf5f-06d1a55ef49d tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498146f6a6814129b393e7084057bfd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db07feb3a43432999da539b6b85fb2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:38:43.461538 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-edd00444-c767-4300-bf5f-06d1a55ef49d tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] 10.222.0.45 "GET /compute/v2.1/servers/6104a6dc-afee-486a-a867-490dad16c883" status: 200 len: 1319 microversion: 2.1 time: 0.377098 Jan 21 09:38:43.462207 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 267/531] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:38:43 2022] GET /compute/v2.1/servers/6104a6dc-afee-486a-a867-490dad16c883 => generated 1319 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:38:43.654124 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-5427c1b7-81f9-4df3-960e-7a91a1f5476d tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db87258db1424ce7a8399fdd05efe3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89d1b21ad8471a8a9a82adac2594c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:38:43.662110 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-5427c1b7-81f9-4df3-960e-7a91a1f5476d tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] 10.222.0.45 "GET /compute/v2.1/servers/4e67b25e-7e65-4975-bafa-fceafcd53647" status: 200 len: 1566 microversion: 2.1 time: 0.336356 Jan 21 09:38:43.662693 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 265/532] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:38:43 2022] GET /compute/v2.1/servers/4e67b25e-7e65-4975-bafa-fceafcd53647 => generated 1566 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 09:38:43.896351 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-4514ac02-8afb-4e20-bda5-9b741a17a40e tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:38:43.896954 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-4514ac02-8afb-4e20-bda5-9b741a17a40e tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] [instance: 750f8ae5-b267-4b76-bb13-170071722932] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:38:43.902916 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-4514ac02-8afb-4e20-bda5-9b741a17a40e tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:43.903366 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-4514ac02-8afb-4e20-bda5-9b741a17a40e tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:43.904132 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-4514ac02-8afb-4e20-bda5-9b741a17a40e tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:43.904576 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-4514ac02-8afb-4e20-bda5-9b741a17a40e tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:43.922466 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-b039dd0a-3efd-499e-81fe-c231fe840db9 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:38:43.923136 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-b039dd0a-3efd-499e-81fe-c231fe840db9 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] [instance: 59ad64a5-af93-44ef-8031-fd2f2d18a901] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:38:43.929594 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-b039dd0a-3efd-499e-81fe-c231fe840db9 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:43.930046 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-b039dd0a-3efd-499e-81fe-c231fe840db9 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:43.930825 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-b039dd0a-3efd-499e-81fe-c231fe840db9 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:43.931255 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-b039dd0a-3efd-499e-81fe-c231fe840db9 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:44.181876 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-4514ac02-8afb-4e20-bda5-9b741a17a40e tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a8838f167743678110ca0a9d5a2484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10ed49573f464cc18794b94fd1c115ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:38:44.198227 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-4514ac02-8afb-4e20-bda5-9b741a17a40e tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] 10.222.0.45 "GET /compute/v2.1/servers/750f8ae5-b267-4b76-bb13-170071722932" status: 200 len: 1357 microversion: 2.1 time: 0.305974 Jan 21 09:38:44.203244 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 268/533] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:38:43 2022] GET /compute/v2.1/servers/750f8ae5-b267-4b76-bb13-170071722932 => generated 1357 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:38:44.203389 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-b039dd0a-3efd-499e-81fe-c231fe840db9 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:38:44.206618 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-018d1051-1577-4e46-9b6a-1c1b63af5772 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:38:44.207356 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-018d1051-1577-4e46-9b6a-1c1b63af5772 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] [instance: a4e4d869-a178-4acd-8305-895d478f77ce] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:38:44.215043 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-018d1051-1577-4e46-9b6a-1c1b63af5772 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:44.215496 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-018d1051-1577-4e46-9b6a-1c1b63af5772 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:44.216358 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-018d1051-1577-4e46-9b6a-1c1b63af5772 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:44.216864 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-018d1051-1577-4e46-9b6a-1c1b63af5772 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:44.220337 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-b039dd0a-3efd-499e-81fe-c231fe840db9 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:38:44.231978 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-b039dd0a-3efd-499e-81fe-c231fe840db9 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:38:44.231978 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-b039dd0a-3efd-499e-81fe-c231fe840db9 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "GET /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901" status: 200 len: 1750 microversion: 2.20 time: 0.304857 Jan 21 09:38:44.237649 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 266/534] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jan 21 09:38:43 2022] GET /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901 => generated 1750 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 21 09:38:44.244028 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.wsgi [None req-018d1051-1577-4e46-9b6a-1c1b63af5772 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] HTTP exception thrown: Instance a4e4d869-a178-4acd-8305-895d478f77ce could not be found. Jan 21 09:38:44.245344 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-018d1051-1577-4e46-9b6a-1c1b63af5772 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] Returning 404 to user: Instance a4e4d869-a178-4acd-8305-895d478f77ce could not be found. {{(pid=123387) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 21 09:38:44.247266 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-018d1051-1577-4e46-9b6a-1c1b63af5772 tempest-VolumesActionsTest-600326628 tempest-VolumesActionsTest-600326628-project] 10.222.0.45 "GET /compute/v2.1/servers/a4e4d869-a178-4acd-8305-895d478f77ce" status: 404 len: 111 microversion: 2.1 time: 0.046687 Jan 21 09:38:44.248225 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 269/535] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:38:44 2022] GET /compute/v2.1/servers/a4e4d869-a178-4acd-8305-895d478f77ce => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 21 09:38:44.360089 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [req-b4ca12da-2104-42bd-845e-79fd0b3d28ce req-f2834193-4636-40af-ad5a-989a870dd4be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4e4d869-a178-4acd-8305-895d478f77ce", "name": "network-vif-deleted", "tag": "c37f8b48-fdff-490a-a961-319445aac8a3"}]} {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:38:44.362724 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 21 09:38:44.362724 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: warnings.warn(msg) Jan 21 09:38:44.370265 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [req-b4ca12da-2104-42bd-845e-79fd0b3d28ce req-f2834193-4636-40af-ad5a-989a870dd4be service nova] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:44.370713 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [req-b4ca12da-2104-42bd-845e-79fd0b3d28ce req-f2834193-4636-40af-ad5a-989a870dd4be service nova] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:44.388243 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.compute.server_external_events [req-b4ca12da-2104-42bd-845e-79fd0b3d28ce req-f2834193-4636-40af-ad5a-989a870dd4be service nova] Creating event network-vif-deleted:c37f8b48-fdff-490a-a961-319445aac8a3 for instance a4e4d869-a178-4acd-8305-895d478f77ce on hv-cinder-80403 Jan 21 09:38:44.394984 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [req-b4ca12da-2104-42bd-845e-79fd0b3d28ce req-f2834193-4636-40af-ad5a-989a870dd4be service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038399 Jan 21 09:38:44.395588 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 267/536] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Jan 21 09:38:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 09:38:44.480244 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-bafc49ff-8540-4a0e-b1ed-d3766574ef85 tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:38:44.481800 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-bafc49ff-8540-4a0e-b1ed-d3766574ef85 tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] [instance: 6104a6dc-afee-486a-a867-490dad16c883] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:38:44.490848 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-bafc49ff-8540-4a0e-b1ed-d3766574ef85 tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:44.491752 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-bafc49ff-8540-4a0e-b1ed-d3766574ef85 tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:44.493009 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-bafc49ff-8540-4a0e-b1ed-d3766574ef85 tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:44.493381 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-bafc49ff-8540-4a0e-b1ed-d3766574ef85 tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:44.666938 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-bafc49ff-8540-4a0e-b1ed-d3766574ef85 tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498146f6a6814129b393e7084057bfd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db07feb3a43432999da539b6b85fb2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:38:44.675305 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-bafc49ff-8540-4a0e-b1ed-d3766574ef85 tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] 10.222.0.45 "GET /compute/v2.1/servers/6104a6dc-afee-486a-a867-490dad16c883" status: 200 len: 1319 microversion: 2.1 time: 0.199455 Jan 21 09:38:44.685064 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 270/537] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:38:44 2022] GET /compute/v2.1/servers/6104a6dc-afee-486a-a867-490dad16c883 => generated 1319 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:38:44.699196 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-7d4c8af6-8b92-4e6d-925f-00a6a6604f9c tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:38:44.699859 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-7d4c8af6-8b92-4e6d-925f-00a6a6604f9c tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] [instance: 4e67b25e-7e65-4975-bafa-fceafcd53647] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:38:44.706705 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-7d4c8af6-8b92-4e6d-925f-00a6a6604f9c tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:44.707058 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-7d4c8af6-8b92-4e6d-925f-00a6a6604f9c tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:44.707836 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-7d4c8af6-8b92-4e6d-925f-00a6a6604f9c tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:44.708265 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-7d4c8af6-8b92-4e6d-925f-00a6a6604f9c tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:44.843714 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-7d4c8af6-8b92-4e6d-925f-00a6a6604f9c tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db87258db1424ce7a8399fdd05efe3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89d1b21ad8471a8a9a82adac2594c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:38:44.856838 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-7d4c8af6-8b92-4e6d-925f-00a6a6604f9c tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] 10.222.0.45 "GET /compute/v2.1/servers/4e67b25e-7e65-4975-bafa-fceafcd53647" status: 200 len: 1566 microversion: 2.1 time: 0.161183 Jan 21 09:38:44.858726 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 268/538] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:38:44 2022] GET /compute/v2.1/servers/4e67b25e-7e65-4975-bafa-fceafcd53647 => generated 1566 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:38:45.215317 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-03b395b5-7e34-4f63-bc07-3793cc14f2cf tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:38:45.215924 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-03b395b5-7e34-4f63-bc07-3793cc14f2cf tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] [instance: 750f8ae5-b267-4b76-bb13-170071722932] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:38:45.222394 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-03b395b5-7e34-4f63-bc07-3793cc14f2cf tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:45.222845 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-03b395b5-7e34-4f63-bc07-3793cc14f2cf tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:45.223651 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-03b395b5-7e34-4f63-bc07-3793cc14f2cf tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:45.224088 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-03b395b5-7e34-4f63-bc07-3793cc14f2cf tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:45.254891 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-e995b443-5d1b-497c-a417-4418d1795924 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:38:45.256182 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-e995b443-5d1b-497c-a417-4418d1795924 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] [instance: 59ad64a5-af93-44ef-8031-fd2f2d18a901] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:38:45.262305 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-e995b443-5d1b-497c-a417-4418d1795924 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:45.262973 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-e995b443-5d1b-497c-a417-4418d1795924 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:45.263881 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-e995b443-5d1b-497c-a417-4418d1795924 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:45.264320 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-e995b443-5d1b-497c-a417-4418d1795924 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:45.417034 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-03b395b5-7e34-4f63-bc07-3793cc14f2cf tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a8838f167743678110ca0a9d5a2484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10ed49573f464cc18794b94fd1c115ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:38:45.426681 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-03b395b5-7e34-4f63-bc07-3793cc14f2cf tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] 10.222.0.45 "GET /compute/v2.1/servers/750f8ae5-b267-4b76-bb13-170071722932" status: 200 len: 1357 microversion: 2.1 time: 0.214717 Jan 21 09:38:45.427843 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 271/539] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:38:45 2022] GET /compute/v2.1/servers/750f8ae5-b267-4b76-bb13-170071722932 => generated 1357 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:38:45.476779 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-e995b443-5d1b-497c-a417-4418d1795924 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:38:45.485527 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-e995b443-5d1b-497c-a417-4418d1795924 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:38:45.487707 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-e995b443-5d1b-497c-a417-4418d1795924 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:38:45.488962 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-e995b443-5d1b-497c-a417-4418d1795924 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "GET /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901" status: 200 len: 1752 microversion: 2.20 time: 0.237925 Jan 21 09:38:45.489748 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 269/540] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jan 21 09:38:45 2022] GET /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901 => generated 1752 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 21 09:38:45.697009 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-656cd745-4b36-454d-b490-56f464e71c8a tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:38:45.697644 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-656cd745-4b36-454d-b490-56f464e71c8a tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] [instance: 6104a6dc-afee-486a-a867-490dad16c883] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:38:45.703802 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-656cd745-4b36-454d-b490-56f464e71c8a tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:45.704251 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-656cd745-4b36-454d-b490-56f464e71c8a tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:45.705239 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-656cd745-4b36-454d-b490-56f464e71c8a tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:45.706107 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-656cd745-4b36-454d-b490-56f464e71c8a tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:45.826122 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-632ec90c-05a8-4ca5-8777-90ea75dfdaa2 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:38:45.826623 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-632ec90c-05a8-4ca5-8777-90ea75dfdaa2 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] [instance: 0f393a36-e048-4228-a48c-9ed725c3e71c] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:38:45.832844 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-632ec90c-05a8-4ca5-8777-90ea75dfdaa2 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:45.833560 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-632ec90c-05a8-4ca5-8777-90ea75dfdaa2 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:45.834359 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-632ec90c-05a8-4ca5-8777-90ea75dfdaa2 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:45.840359 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-632ec90c-05a8-4ca5-8777-90ea75dfdaa2 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:45.854773 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-656cd745-4b36-454d-b490-56f464e71c8a tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498146f6a6814129b393e7084057bfd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db07feb3a43432999da539b6b85fb2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:38:45.860731 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-656cd745-4b36-454d-b490-56f464e71c8a tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] 10.222.0.45 "GET /compute/v2.1/servers/6104a6dc-afee-486a-a867-490dad16c883" status: 200 len: 1319 microversion: 2.1 time: 0.167231 Jan 21 09:38:45.862090 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 272/541] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:38:45 2022] GET /compute/v2.1/servers/6104a6dc-afee-486a-a867-490dad16c883 => generated 1319 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:38:45.876192 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-08122cfe-04ed-456a-b764-4cff22f400e2 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:38:45.876802 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-08122cfe-04ed-456a-b764-4cff22f400e2 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] [instance: 4e67b25e-7e65-4975-bafa-fceafcd53647] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:38:45.884537 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-08122cfe-04ed-456a-b764-4cff22f400e2 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:45.885122 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-08122cfe-04ed-456a-b764-4cff22f400e2 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:45.889205 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-08122cfe-04ed-456a-b764-4cff22f400e2 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:45.889205 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-08122cfe-04ed-456a-b764-4cff22f400e2 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:45.938084 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.objects.instance [None req-632ec90c-05a8-4ca5-8777-90ea75dfdaa2 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lazy-loading 'services' on Instance uuid 0f393a36-e048-4228-a48c-9ed725c3e71c {{(pid=123386) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 21 09:38:46.068307 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-08122cfe-04ed-456a-b764-4cff22f400e2 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db87258db1424ce7a8399fdd05efe3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89d1b21ad8471a8a9a82adac2594c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:38:46.076305 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-08122cfe-04ed-456a-b764-4cff22f400e2 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] 10.222.0.45 "GET /compute/v2.1/servers/4e67b25e-7e65-4975-bafa-fceafcd53647" status: 200 len: 1566 microversion: 2.1 time: 0.203927 Jan 21 09:38:46.076867 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 273/542] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:38:45 2022] GET /compute/v2.1/servers/4e67b25e-7e65-4975-bafa-fceafcd53647 => generated 1566 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 09:38:46.210389 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-632ec90c-05a8-4ca5-8777-90ea75dfdaa2 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] 10.222.0.45 "DELETE /compute/v2.1/servers/0f393a36-e048-4228-a48c-9ed725c3e71c/os-volume_attachments/6f656268-11e5-4bae-b345-c6bf22cdd3c2" status: 202 len: 0 microversion: 2.1 time: 0.387675 Jan 21 09:38:46.210909 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 270/543] 10.222.0.45 () {58 vars in 1415 bytes} [Fri Jan 21 09:38:45 2022] DELETE /compute/v2.1/servers/0f393a36-e048-4228-a48c-9ed725c3e71c/os-volume_attachments/6f656268-11e5-4bae-b345-c6bf22cdd3c2 => generated 0 bytes in 391 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 21 09:38:46.219935 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-ddf6779b-c39c-404e-b8b6-678070adc075 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:38:46.221529 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-ddf6779b-c39c-404e-b8b6-678070adc075 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] [instance: 0f393a36-e048-4228-a48c-9ed725c3e71c] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:38:46.228315 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-ddf6779b-c39c-404e-b8b6-678070adc075 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:46.229095 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-ddf6779b-c39c-404e-b8b6-678070adc075 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:46.230252 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-ddf6779b-c39c-404e-b8b6-678070adc075 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:46.230742 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-ddf6779b-c39c-404e-b8b6-678070adc075 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:46.271148 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-ddf6779b-c39c-404e-b8b6-678070adc075 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] 10.222.0.45 "GET /compute/v2.1/servers/0f393a36-e048-4228-a48c-9ed725c3e71c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055320 Jan 21 09:38:46.272038 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 274/544] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Jan 21 09:38:46 2022] GET /compute/v2.1/servers/0f393a36-e048-4228-a48c-9ed725c3e71c/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 09:38:46.448002 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-6bcfe5d1-6c5c-48c8-b3fc-d08e68edc59a tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:38:46.448694 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-6bcfe5d1-6c5c-48c8-b3fc-d08e68edc59a tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] [instance: 750f8ae5-b267-4b76-bb13-170071722932] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:38:46.454902 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-6bcfe5d1-6c5c-48c8-b3fc-d08e68edc59a tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:46.456019 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-6bcfe5d1-6c5c-48c8-b3fc-d08e68edc59a tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:46.456806 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-6bcfe5d1-6c5c-48c8-b3fc-d08e68edc59a tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:46.457266 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-6bcfe5d1-6c5c-48c8-b3fc-d08e68edc59a tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:46.508416 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-6dea71e0-031e-4d2b-b511-4105f4b004b7 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:38:46.508926 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-6dea71e0-031e-4d2b-b511-4105f4b004b7 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] [instance: 59ad64a5-af93-44ef-8031-fd2f2d18a901] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:38:46.514806 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-6dea71e0-031e-4d2b-b511-4105f4b004b7 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:46.515280 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-6dea71e0-031e-4d2b-b511-4105f4b004b7 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:46.516103 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-6dea71e0-031e-4d2b-b511-4105f4b004b7 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:46.516527 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-6dea71e0-031e-4d2b-b511-4105f4b004b7 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:46.646893 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-6bcfe5d1-6c5c-48c8-b3fc-d08e68edc59a tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a8838f167743678110ca0a9d5a2484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10ed49573f464cc18794b94fd1c115ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:38:46.654658 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-6bcfe5d1-6c5c-48c8-b3fc-d08e68edc59a tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] 10.222.0.45 "GET /compute/v2.1/servers/750f8ae5-b267-4b76-bb13-170071722932" status: 200 len: 1547 microversion: 2.1 time: 0.211492 Jan 21 09:38:46.655404 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 271/545] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:38:46 2022] GET /compute/v2.1/servers/750f8ae5-b267-4b76-bb13-170071722932 => generated 1547 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:38:46.678270 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-d45aa7b7-282e-4b74-b99b-f59abd9a3b89 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:38:46.679046 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-d45aa7b7-282e-4b74-b99b-f59abd9a3b89 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] [instance: 750f8ae5-b267-4b76-bb13-170071722932] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:38:46.684881 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-d45aa7b7-282e-4b74-b99b-f59abd9a3b89 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:46.685350 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-d45aa7b7-282e-4b74-b99b-f59abd9a3b89 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:46.686139 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-d45aa7b7-282e-4b74-b99b-f59abd9a3b89 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:46.686571 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-d45aa7b7-282e-4b74-b99b-f59abd9a3b89 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:46.710468 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-6dea71e0-031e-4d2b-b511-4105f4b004b7 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:38:46.719779 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-6dea71e0-031e-4d2b-b511-4105f4b004b7 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:38:46.724707 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-6dea71e0-031e-4d2b-b511-4105f4b004b7 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:38:46.725948 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-6dea71e0-031e-4d2b-b511-4105f4b004b7 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "GET /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901" status: 200 len: 1752 microversion: 2.20 time: 0.221417 Jan 21 09:38:46.726557 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 275/546] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jan 21 09:38:46 2022] GET /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901 => generated 1752 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 21 09:38:46.819559 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-d45aa7b7-282e-4b74-b99b-f59abd9a3b89 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a8838f167743678110ca0a9d5a2484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10ed49573f464cc18794b94fd1c115ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:38:46.827392 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-d45aa7b7-282e-4b74-b99b-f59abd9a3b89 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] 10.222.0.45 "GET /compute/v2.1/servers/750f8ae5-b267-4b76-bb13-170071722932" status: 200 len: 1547 microversion: 2.1 time: 0.153399 Jan 21 09:38:46.827950 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 272/547] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:38:46 2022] GET /compute/v2.1/servers/750f8ae5-b267-4b76-bb13-170071722932 => generated 1547 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 09:38:46.843952 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-c0db7f3e-6283-4e9c-8cb0-0ca8ba67f763 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:38:46.847642 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 21 09:38:46.847642 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: warnings.warn(msg) Jan 21 09:38:46.848678 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-c0db7f3e-6283-4e9c-8cb0-0ca8ba67f763 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '84a8838f167743678110ca0a9d5a2484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10ed49573f464cc18794b94fd1c115ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:38:46.849376 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-c0db7f3e-6283-4e9c-8cb0-0ca8ba67f763 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Searching by: {'deleted': False, 'project_id': '10ed49573f464cc18794b94fd1c115ee'} {{(pid=123387) get_all /opt/stack/nova/nova/compute/api.py:2907}} Jan 21 09:38:46.856226 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-c0db7f3e-6283-4e9c-8cb0-0ca8ba67f763 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:46.856672 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-c0db7f3e-6283-4e9c-8cb0-0ca8ba67f763 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:46.857505 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-c0db7f3e-6283-4e9c-8cb0-0ca8ba67f763 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:46.857933 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-c0db7f3e-6283-4e9c-8cb0-0ca8ba67f763 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:46.882296 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-24b3782b-835f-451a-add1-a02122a21b9d tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:38:46.883073 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-24b3782b-835f-451a-add1-a02122a21b9d tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] [instance: 6104a6dc-afee-486a-a867-490dad16c883] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:38:46.889057 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-24b3782b-835f-451a-add1-a02122a21b9d tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:46.889548 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-24b3782b-835f-451a-add1-a02122a21b9d tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:46.890337 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-24b3782b-835f-451a-add1-a02122a21b9d tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:46.890778 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-24b3782b-835f-451a-add1-a02122a21b9d tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:46.951806 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.multi_cell_list [None req-c0db7f3e-6283-4e9c-8cb0-0ca8ba67f763 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=123387) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jan 21 09:38:47.033687 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-24b3782b-835f-451a-add1-a02122a21b9d tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498146f6a6814129b393e7084057bfd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db07feb3a43432999da539b6b85fb2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:38:47.041160 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-24b3782b-835f-451a-add1-a02122a21b9d tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] 10.222.0.45 "GET /compute/v2.1/servers/6104a6dc-afee-486a-a867-490dad16c883" status: 200 len: 1319 microversion: 2.1 time: 0.163755 Jan 21 09:38:47.041736 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 273/548] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:38:46 2022] GET /compute/v2.1/servers/6104a6dc-afee-486a-a867-490dad16c883 => generated 1319 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 09:38:47.066803 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-c0db7f3e-6283-4e9c-8cb0-0ca8ba67f763 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] 10.222.0.45 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.226546 Jan 21 09:38:47.067381 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 276/549] 10.222.0.45 () {58 vars in 1124 bytes} [Fri Jan 21 09:38:46 2022] GET /compute/v2.1/servers => generated 342 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 09:38:47.077256 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-97c09e50-f003-4c3f-b580-837834638c7b tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:38:47.077884 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-97c09e50-f003-4c3f-b580-837834638c7b tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] [instance: 750f8ae5-b267-4b76-bb13-170071722932] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:38:47.084912 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-97c09e50-f003-4c3f-b580-837834638c7b tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:47.085531 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-97c09e50-f003-4c3f-b580-837834638c7b tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:47.086754 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-97c09e50-f003-4c3f-b580-837834638c7b tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:47.087518 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-97c09e50-f003-4c3f-b580-837834638c7b tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:47.093834 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-e104bc09-727b-4cd9-a507-f9319c7e101c tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:38:47.094135 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-e104bc09-727b-4cd9-a507-f9319c7e101c tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] [instance: 4e67b25e-7e65-4975-bafa-fceafcd53647] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:38:47.100141 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-e104bc09-727b-4cd9-a507-f9319c7e101c tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:47.100596 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-e104bc09-727b-4cd9-a507-f9319c7e101c tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:47.101421 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-e104bc09-727b-4cd9-a507-f9319c7e101c tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:47.101866 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-e104bc09-727b-4cd9-a507-f9319c7e101c tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:47.288392 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-97c09e50-f003-4c3f-b580-837834638c7b tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a8838f167743678110ca0a9d5a2484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10ed49573f464cc18794b94fd1c115ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:38:47.295804 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-97c09e50-f003-4c3f-b580-837834638c7b tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] 10.222.0.45 "GET /compute/v2.1/servers/750f8ae5-b267-4b76-bb13-170071722932" status: 200 len: 1547 microversion: 2.1 time: 0.222110 Jan 21 09:38:47.296621 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 274/550] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:38:47 2022] GET /compute/v2.1/servers/750f8ae5-b267-4b76-bb13-170071722932 => generated 1547 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:38:47.300142 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-e104bc09-727b-4cd9-a507-f9319c7e101c tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db87258db1424ce7a8399fdd05efe3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89d1b21ad8471a8a9a82adac2594c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:38:47.304754 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-be0ddeae-cfea-4d5f-a984-edd3d4d59ea4 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:38:47.306009 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-be0ddeae-cfea-4d5f-a984-edd3d4d59ea4 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] [instance: 0f393a36-e048-4228-a48c-9ed725c3e71c] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:38:47.309568 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-e104bc09-727b-4cd9-a507-f9319c7e101c tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] 10.222.0.45 "GET /compute/v2.1/servers/4e67b25e-7e65-4975-bafa-fceafcd53647" status: 200 len: 1566 microversion: 2.1 time: 0.219580 Jan 21 09:38:47.310324 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 277/551] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:38:47 2022] GET /compute/v2.1/servers/4e67b25e-7e65-4975-bafa-fceafcd53647 => generated 1566 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 09:38:47.312508 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-be0ddeae-cfea-4d5f-a984-edd3d4d59ea4 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:47.313197 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-be0ddeae-cfea-4d5f-a984-edd3d4d59ea4 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:47.313910 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-be0ddeae-cfea-4d5f-a984-edd3d4d59ea4 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:47.314346 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-be0ddeae-cfea-4d5f-a984-edd3d4d59ea4 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:47.346184 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-be0ddeae-cfea-4d5f-a984-edd3d4d59ea4 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] 10.222.0.45 "GET /compute/v2.1/servers/0f393a36-e048-4228-a48c-9ed725c3e71c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048504 Jan 21 09:38:47.346897 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 275/552] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Jan 21 09:38:47 2022] GET /compute/v2.1/servers/0f393a36-e048-4228-a48c-9ed725c3e71c/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 09:38:47.744642 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-58fdae0a-9398-4bb7-b746-290eeb7bc1c1 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:38:47.745288 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-58fdae0a-9398-4bb7-b746-290eeb7bc1c1 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] [instance: 59ad64a5-af93-44ef-8031-fd2f2d18a901] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:38:47.752554 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-58fdae0a-9398-4bb7-b746-290eeb7bc1c1 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:47.752983 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-58fdae0a-9398-4bb7-b746-290eeb7bc1c1 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:47.753798 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-58fdae0a-9398-4bb7-b746-290eeb7bc1c1 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:47.755395 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-58fdae0a-9398-4bb7-b746-290eeb7bc1c1 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:47.894163 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-58fdae0a-9398-4bb7-b746-290eeb7bc1c1 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:38:47.903313 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-58fdae0a-9398-4bb7-b746-290eeb7bc1c1 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:38:47.904850 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-58fdae0a-9398-4bb7-b746-290eeb7bc1c1 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:38:47.906157 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-58fdae0a-9398-4bb7-b746-290eeb7bc1c1 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "GET /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901" status: 200 len: 1752 microversion: 2.20 time: 0.165506 Jan 21 09:38:47.906721 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 278/553] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jan 21 09:38:47 2022] GET /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901 => generated 1752 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 21 09:38:48.058517 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-f54349de-249e-4707-8acf-3e72464410db tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:38:48.059108 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-f54349de-249e-4707-8acf-3e72464410db tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] [instance: 6104a6dc-afee-486a-a867-490dad16c883] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:38:48.066461 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-f54349de-249e-4707-8acf-3e72464410db tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:48.066904 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-f54349de-249e-4707-8acf-3e72464410db tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:48.067689 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-f54349de-249e-4707-8acf-3e72464410db tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:48.068151 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-f54349de-249e-4707-8acf-3e72464410db tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:48.209511 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-f54349de-249e-4707-8acf-3e72464410db tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498146f6a6814129b393e7084057bfd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db07feb3a43432999da539b6b85fb2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:38:48.217326 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-f54349de-249e-4707-8acf-3e72464410db tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] 10.222.0.45 "GET /compute/v2.1/servers/6104a6dc-afee-486a-a867-490dad16c883" status: 200 len: 1319 microversion: 2.1 time: 0.162569 Jan 21 09:38:48.217976 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 276/554] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:38:48 2022] GET /compute/v2.1/servers/6104a6dc-afee-486a-a867-490dad16c883 => generated 1319 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:38:48.327827 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-0fdf3916-c82d-4e2d-b059-34a2793001c3 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:38:48.331757 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-0fdf3916-c82d-4e2d-b059-34a2793001c3 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] [instance: 4e67b25e-7e65-4975-bafa-fceafcd53647] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:38:48.339203 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-0fdf3916-c82d-4e2d-b059-34a2793001c3 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:48.340270 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-0fdf3916-c82d-4e2d-b059-34a2793001c3 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:48.342350 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-0fdf3916-c82d-4e2d-b059-34a2793001c3 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:48.343028 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-0fdf3916-c82d-4e2d-b059-34a2793001c3 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:48.357850 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-094ff448-1563-43e0-ad47-1a385cff0895 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:38:48.358927 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-094ff448-1563-43e0-ad47-1a385cff0895 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] [instance: 0f393a36-e048-4228-a48c-9ed725c3e71c] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:38:48.365550 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-094ff448-1563-43e0-ad47-1a385cff0895 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:48.366136 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-094ff448-1563-43e0-ad47-1a385cff0895 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:48.366921 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-094ff448-1563-43e0-ad47-1a385cff0895 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:48.367442 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-094ff448-1563-43e0-ad47-1a385cff0895 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:48.399831 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-094ff448-1563-43e0-ad47-1a385cff0895 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] 10.222.0.45 "GET /compute/v2.1/servers/0f393a36-e048-4228-a48c-9ed725c3e71c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045623 Jan 21 09:38:48.400422 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 277/555] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Jan 21 09:38:48 2022] GET /compute/v2.1/servers/0f393a36-e048-4228-a48c-9ed725c3e71c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 09:38:48.501067 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-0fdf3916-c82d-4e2d-b059-34a2793001c3 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db87258db1424ce7a8399fdd05efe3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89d1b21ad8471a8a9a82adac2594c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:38:48.510078 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-0fdf3916-c82d-4e2d-b059-34a2793001c3 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] 10.222.0.45 "GET /compute/v2.1/servers/4e67b25e-7e65-4975-bafa-fceafcd53647" status: 200 len: 1566 microversion: 2.1 time: 0.186138 Jan 21 09:38:48.510645 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 279/556] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:38:48 2022] GET /compute/v2.1/servers/4e67b25e-7e65-4975-bafa-fceafcd53647 => generated 1566 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:38:48.925778 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-492381a1-e1fe-4f77-a6ca-ce11f18ebe0c tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:38:48.926377 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-492381a1-e1fe-4f77-a6ca-ce11f18ebe0c tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] [instance: 59ad64a5-af93-44ef-8031-fd2f2d18a901] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:38:48.932423 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-492381a1-e1fe-4f77-a6ca-ce11f18ebe0c tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:48.932869 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-492381a1-e1fe-4f77-a6ca-ce11f18ebe0c tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:48.933686 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-492381a1-e1fe-4f77-a6ca-ce11f18ebe0c tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:48.934122 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-492381a1-e1fe-4f77-a6ca-ce11f18ebe0c tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:49.069183 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-492381a1-e1fe-4f77-a6ca-ce11f18ebe0c tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:38:49.078255 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-492381a1-e1fe-4f77-a6ca-ce11f18ebe0c tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:38:49.091285 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-492381a1-e1fe-4f77-a6ca-ce11f18ebe0c tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:38:49.094319 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-492381a1-e1fe-4f77-a6ca-ce11f18ebe0c tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "GET /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901" status: 200 len: 1752 microversion: 2.20 time: 0.172729 Jan 21 09:38:49.108363 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 278/557] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jan 21 09:38:48 2022] GET /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901 => generated 1752 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 21 09:38:49.235625 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-424058d8-15d0-4e1f-9bd2-0cbe45c2e797 tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:38:49.236496 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-424058d8-15d0-4e1f-9bd2-0cbe45c2e797 tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] [instance: 6104a6dc-afee-486a-a867-490dad16c883] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:38:49.242831 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-424058d8-15d0-4e1f-9bd2-0cbe45c2e797 tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:49.243284 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-424058d8-15d0-4e1f-9bd2-0cbe45c2e797 tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:49.244116 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-424058d8-15d0-4e1f-9bd2-0cbe45c2e797 tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:49.244590 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-424058d8-15d0-4e1f-9bd2-0cbe45c2e797 tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:49.412870 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-04b21635-c4aa-436e-b63a-d5202bd3130c tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:38:49.413849 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-04b21635-c4aa-436e-b63a-d5202bd3130c tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] [instance: 0f393a36-e048-4228-a48c-9ed725c3e71c] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:38:49.420363 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-04b21635-c4aa-436e-b63a-d5202bd3130c tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:49.420817 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-04b21635-c4aa-436e-b63a-d5202bd3130c tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:49.421655 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-04b21635-c4aa-436e-b63a-d5202bd3130c tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:49.422092 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-04b21635-c4aa-436e-b63a-d5202bd3130c tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:49.457451 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-04b21635-c4aa-436e-b63a-d5202bd3130c tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] 10.222.0.45 "GET /compute/v2.1/servers/0f393a36-e048-4228-a48c-9ed725c3e71c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048636 Jan 21 09:38:49.458042 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 279/558] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Jan 21 09:38:49 2022] GET /compute/v2.1/servers/0f393a36-e048-4228-a48c-9ed725c3e71c/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 21 09:38:49.527129 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-5a0170a6-bb0a-43a9-a0ec-f7890fd1c3b9 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:38:49.527941 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-5a0170a6-bb0a-43a9-a0ec-f7890fd1c3b9 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] [instance: 4e67b25e-7e65-4975-bafa-fceafcd53647] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:38:49.534478 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-5a0170a6-bb0a-43a9-a0ec-f7890fd1c3b9 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:49.535265 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-5a0170a6-bb0a-43a9-a0ec-f7890fd1c3b9 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:49.536135 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-5a0170a6-bb0a-43a9-a0ec-f7890fd1c3b9 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:49.536753 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-5a0170a6-bb0a-43a9-a0ec-f7890fd1c3b9 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:49.798122 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-424058d8-15d0-4e1f-9bd2-0cbe45c2e797 tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498146f6a6814129b393e7084057bfd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db07feb3a43432999da539b6b85fb2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:38:49.806943 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-424058d8-15d0-4e1f-9bd2-0cbe45c2e797 tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] 10.222.0.45 "GET /compute/v2.1/servers/6104a6dc-afee-486a-a867-490dad16c883" status: 200 len: 1319 microversion: 2.1 time: 0.574859 Jan 21 09:38:49.807419 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 280/559] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:38:49 2022] GET /compute/v2.1/servers/6104a6dc-afee-486a-a867-490dad16c883 => generated 1319 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:38:49.829813 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-5a0170a6-bb0a-43a9-a0ec-f7890fd1c3b9 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db87258db1424ce7a8399fdd05efe3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89d1b21ad8471a8a9a82adac2594c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:38:49.837568 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-5a0170a6-bb0a-43a9-a0ec-f7890fd1c3b9 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] 10.222.0.45 "GET /compute/v2.1/servers/4e67b25e-7e65-4975-bafa-fceafcd53647" status: 200 len: 1566 microversion: 2.1 time: 0.314584 Jan 21 09:38:49.838149 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 280/560] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:38:49 2022] GET /compute/v2.1/servers/4e67b25e-7e65-4975-bafa-fceafcd53647 => generated 1566 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:38:50.113857 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-042e4c08-a2d1-4420-a23d-008b0e83b94e tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:38:50.114498 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-042e4c08-a2d1-4420-a23d-008b0e83b94e tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] [instance: 59ad64a5-af93-44ef-8031-fd2f2d18a901] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:38:50.120378 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-042e4c08-a2d1-4420-a23d-008b0e83b94e tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:50.120854 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-042e4c08-a2d1-4420-a23d-008b0e83b94e tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:50.121729 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-042e4c08-a2d1-4420-a23d-008b0e83b94e tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:50.122167 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-042e4c08-a2d1-4420-a23d-008b0e83b94e tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:50.258230 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-042e4c08-a2d1-4420-a23d-008b0e83b94e tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:38:50.266529 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-042e4c08-a2d1-4420-a23d-008b0e83b94e tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:38:50.268814 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-042e4c08-a2d1-4420-a23d-008b0e83b94e tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:38:50.270055 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-042e4c08-a2d1-4420-a23d-008b0e83b94e tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "GET /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901" status: 200 len: 1752 microversion: 2.20 time: 0.160225 Jan 21 09:38:50.270622 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 281/561] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jan 21 09:38:50 2022] GET /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901 => generated 1752 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 21 09:38:50.339083 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-cb0f762c-293d-4f67-895b-6f2bb946f633 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6d0f7122-1337-488c-93ba-3fdc77d1378e"}} {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:38:50.340179 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-cb0f762c-293d-4f67-895b-6f2bb946f633 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] [instance: 750f8ae5-b267-4b76-bb13-170071722932] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:38:50.347339 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-cb0f762c-293d-4f67-895b-6f2bb946f633 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:50.347792 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-cb0f762c-293d-4f67-895b-6f2bb946f633 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:50.348583 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-cb0f762c-293d-4f67-895b-6f2bb946f633 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:50.349040 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-cb0f762c-293d-4f67-895b-6f2bb946f633 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:50.468968 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-21476f60-230e-493d-88c7-d639370c703b tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:38:50.470081 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-21476f60-230e-493d-88c7-d639370c703b tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] [instance: 0f393a36-e048-4228-a48c-9ed725c3e71c] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:38:50.476913 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-21476f60-230e-493d-88c7-d639370c703b tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:50.477416 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-21476f60-230e-493d-88c7-d639370c703b tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:50.478207 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-21476f60-230e-493d-88c7-d639370c703b tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:50.478675 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-21476f60-230e-493d-88c7-d639370c703b tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:50.511072 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-21476f60-230e-493d-88c7-d639370c703b tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] 10.222.0.45 "GET /compute/v2.1/servers/0f393a36-e048-4228-a48c-9ed725c3e71c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045904 Jan 21 09:38:50.511692 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 282/562] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Jan 21 09:38:50 2022] GET /compute/v2.1/servers/0f393a36-e048-4228-a48c-9ed725c3e71c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 21 09:38:50.824033 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-50f7b4c1-0739-4510-baef-ead6b361a599 tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:38:50.824712 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-50f7b4c1-0739-4510-baef-ead6b361a599 tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] [instance: 6104a6dc-afee-486a-a867-490dad16c883] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:38:50.830672 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-50f7b4c1-0739-4510-baef-ead6b361a599 tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:50.831199 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-50f7b4c1-0739-4510-baef-ead6b361a599 tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:50.832135 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-50f7b4c1-0739-4510-baef-ead6b361a599 tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:50.832738 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-50f7b4c1-0739-4510-baef-ead6b361a599 tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:50.986952 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-50f7b4c1-0739-4510-baef-ead6b361a599 tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498146f6a6814129b393e7084057bfd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db07feb3a43432999da539b6b85fb2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:38:50.994756 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-50f7b4c1-0739-4510-baef-ead6b361a599 tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] 10.222.0.45 "GET /compute/v2.1/servers/6104a6dc-afee-486a-a867-490dad16c883" status: 200 len: 1319 microversion: 2.1 time: 0.174455 Jan 21 09:38:50.995329 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 283/563] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:38:50 2022] GET /compute/v2.1/servers/6104a6dc-afee-486a-a867-490dad16c883 => generated 1319 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 09:38:50.999486 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-f14ab6d1-270e-490a-b96b-202919e425c3 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:38:51.000086 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-f14ab6d1-270e-490a-b96b-202919e425c3 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] [instance: 4e67b25e-7e65-4975-bafa-fceafcd53647] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:38:51.011277 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-f14ab6d1-270e-490a-b96b-202919e425c3 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:51.011790 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-f14ab6d1-270e-490a-b96b-202919e425c3 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:51.017939 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-f14ab6d1-270e-490a-b96b-202919e425c3 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:51.017939 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-f14ab6d1-270e-490a-b96b-202919e425c3 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:51.153359 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-cb0f762c-293d-4f67-895b-6f2bb946f633 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] 10.222.0.45 "POST /compute/v2.1/servers/750f8ae5-b267-4b76-bb13-170071722932/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.817820 Jan 21 09:38:51.155089 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 281/564] 10.222.0.45 () {60 vars in 1322 bytes} [Fri Jan 21 09:38:50 2022] POST /compute/v2.1/servers/750f8ae5-b267-4b76-bb13-170071722932/os-volume_attachments => generated 194 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 09:38:51.291413 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-535a9f0f-94d4-46ed-8d65-7b5fccd75dd6 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:38:51.292578 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-535a9f0f-94d4-46ed-8d65-7b5fccd75dd6 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] [instance: 59ad64a5-af93-44ef-8031-fd2f2d18a901] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:38:51.304207 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-535a9f0f-94d4-46ed-8d65-7b5fccd75dd6 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:51.306492 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-535a9f0f-94d4-46ed-8d65-7b5fccd75dd6 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:51.312125 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-535a9f0f-94d4-46ed-8d65-7b5fccd75dd6 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:51.313047 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-535a9f0f-94d4-46ed-8d65-7b5fccd75dd6 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:51.338266 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-f14ab6d1-270e-490a-b96b-202919e425c3 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db87258db1424ce7a8399fdd05efe3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89d1b21ad8471a8a9a82adac2594c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:38:51.351411 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-f14ab6d1-270e-490a-b96b-202919e425c3 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] 10.222.0.45 "GET /compute/v2.1/servers/4e67b25e-7e65-4975-bafa-fceafcd53647" status: 200 len: 1566 microversion: 2.1 time: 0.354937 Jan 21 09:38:51.352364 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 284/565] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:38:50 2022] GET /compute/v2.1/servers/4e67b25e-7e65-4975-bafa-fceafcd53647 => generated 1566 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:38:51.489347 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-535a9f0f-94d4-46ed-8d65-7b5fccd75dd6 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:38:51.497274 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-535a9f0f-94d4-46ed-8d65-7b5fccd75dd6 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:38:51.499568 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-535a9f0f-94d4-46ed-8d65-7b5fccd75dd6 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:38:51.500700 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-535a9f0f-94d4-46ed-8d65-7b5fccd75dd6 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "GET /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901" status: 200 len: 1752 microversion: 2.20 time: 0.213543 Jan 21 09:38:51.512488 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 282/566] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jan 21 09:38:51 2022] GET /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901 => generated 1752 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 21 09:38:51.523118 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-a0c9f82a-c0d5-4493-b10b-d511bfbfdac7 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:38:51.524241 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-a0c9f82a-c0d5-4493-b10b-d511bfbfdac7 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] [instance: 0f393a36-e048-4228-a48c-9ed725c3e71c] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:38:51.531592 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-a0c9f82a-c0d5-4493-b10b-d511bfbfdac7 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:51.532085 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-a0c9f82a-c0d5-4493-b10b-d511bfbfdac7 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:51.532898 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-a0c9f82a-c0d5-4493-b10b-d511bfbfdac7 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:51.533593 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-a0c9f82a-c0d5-4493-b10b-d511bfbfdac7 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:51.572702 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-a0c9f82a-c0d5-4493-b10b-d511bfbfdac7 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] 10.222.0.45 "GET /compute/v2.1/servers/0f393a36-e048-4228-a48c-9ed725c3e71c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053421 Jan 21 09:38:51.577890 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 285/567] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Jan 21 09:38:51 2022] GET /compute/v2.1/servers/0f393a36-e048-4228-a48c-9ed725c3e71c/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 09:38:51.963394 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [req-a6c059db-3a89-4d72-bae1-4e0b00bbe026 req-dfeaf2a1-9697-479f-96e0-c766083e8fc8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6104a6dc-afee-486a-a867-490dad16c883", "name": "network-vif-plugged", "status": "completed", "tag": "ac7a3142-12ec-4772-8b8e-f317cdd18a45"}]} {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:38:51.965127 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 21 09:38:51.965127 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: warnings.warn(msg) Jan 21 09:38:51.981479 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [req-a6c059db-3a89-4d72-bae1-4e0b00bbe026 req-dfeaf2a1-9697-479f-96e0-c766083e8fc8 service nova] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:51.982199 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [req-a6c059db-3a89-4d72-bae1-4e0b00bbe026 req-dfeaf2a1-9697-479f-96e0-c766083e8fc8 service nova] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:51.996841 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.compute.server_external_events [req-a6c059db-3a89-4d72-bae1-4e0b00bbe026 req-dfeaf2a1-9697-479f-96e0-c766083e8fc8 service nova] Creating event network-vif-plugged:ac7a3142-12ec-4772-8b8e-f317cdd18a45 for instance 6104a6dc-afee-486a-a867-490dad16c883 on hv-cinder-80403 Jan 21 09:38:52.001533 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [req-a6c059db-3a89-4d72-bae1-4e0b00bbe026 req-dfeaf2a1-9697-479f-96e0-c766083e8fc8 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042776 Jan 21 09:38:52.002130 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 283/568] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Jan 21 09:38:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 09:38:52.013002 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-027288da-2985-4e92-b6a1-3936bae4d706 tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:38:52.014558 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-027288da-2985-4e92-b6a1-3936bae4d706 tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] [instance: 6104a6dc-afee-486a-a867-490dad16c883] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:38:52.028739 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-027288da-2985-4e92-b6a1-3936bae4d706 tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:52.029345 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-027288da-2985-4e92-b6a1-3936bae4d706 tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:52.030521 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-027288da-2985-4e92-b6a1-3936bae4d706 tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:52.031184 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-027288da-2985-4e92-b6a1-3936bae4d706 tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:52.262060 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-027288da-2985-4e92-b6a1-3936bae4d706 tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498146f6a6814129b393e7084057bfd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db07feb3a43432999da539b6b85fb2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:38:52.275646 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-027288da-2985-4e92-b6a1-3936bae4d706 tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] 10.222.0.45 "GET /compute/v2.1/servers/6104a6dc-afee-486a-a867-490dad16c883" status: 200 len: 1319 microversion: 2.1 time: 0.266463 Jan 21 09:38:52.289431 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 286/569] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:38:52 2022] GET /compute/v2.1/servers/6104a6dc-afee-486a-a867-490dad16c883 => generated 1319 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:38:52.372654 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-c17f5420-c97d-47c2-ba6f-19783ed0c9e5 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:38:52.373402 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-c17f5420-c97d-47c2-ba6f-19783ed0c9e5 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] [instance: 4e67b25e-7e65-4975-bafa-fceafcd53647] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:38:52.387804 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-c17f5420-c97d-47c2-ba6f-19783ed0c9e5 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:52.389263 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-c17f5420-c97d-47c2-ba6f-19783ed0c9e5 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:52.390202 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-c17f5420-c97d-47c2-ba6f-19783ed0c9e5 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:52.390986 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-c17f5420-c97d-47c2-ba6f-19783ed0c9e5 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:52.521581 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-a5384ace-70ca-4367-848c-4d401b30658b tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:38:52.522524 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-a5384ace-70ca-4367-848c-4d401b30658b tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] [instance: 59ad64a5-af93-44ef-8031-fd2f2d18a901] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:38:52.533115 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-a5384ace-70ca-4367-848c-4d401b30658b tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:52.535738 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-a5384ace-70ca-4367-848c-4d401b30658b tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:52.536697 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-a5384ace-70ca-4367-848c-4d401b30658b tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:52.538260 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-a5384ace-70ca-4367-848c-4d401b30658b tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:52.912682 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-c17f5420-c97d-47c2-ba6f-19783ed0c9e5 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db87258db1424ce7a8399fdd05efe3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89d1b21ad8471a8a9a82adac2594c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:38:52.922531 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-c17f5420-c97d-47c2-ba6f-19783ed0c9e5 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] 10.222.0.45 "GET /compute/v2.1/servers/4e67b25e-7e65-4975-bafa-fceafcd53647" status: 200 len: 1566 microversion: 2.1 time: 0.554739 Jan 21 09:38:52.923642 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 284/570] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:38:52 2022] GET /compute/v2.1/servers/4e67b25e-7e65-4975-bafa-fceafcd53647 => generated 1566 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:38:52.929199 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-58d51258-7895-4d8b-af05-4598cdb18fd5 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:38:52.930138 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-58d51258-7895-4d8b-af05-4598cdb18fd5 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] [instance: 0f393a36-e048-4228-a48c-9ed725c3e71c] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:38:52.940553 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-58d51258-7895-4d8b-af05-4598cdb18fd5 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:52.942934 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-58d51258-7895-4d8b-af05-4598cdb18fd5 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:52.942934 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-58d51258-7895-4d8b-af05-4598cdb18fd5 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:52.943217 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-58d51258-7895-4d8b-af05-4598cdb18fd5 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:52.954808 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-a5384ace-70ca-4367-848c-4d401b30658b tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:38:52.964878 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-a5384ace-70ca-4367-848c-4d401b30658b tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:38:52.966449 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-a5384ace-70ca-4367-848c-4d401b30658b tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:38:52.967628 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-a5384ace-70ca-4367-848c-4d401b30658b tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "GET /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901" status: 200 len: 1808 microversion: 2.20 time: 0.451605 Jan 21 09:38:52.968408 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 287/571] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jan 21 09:38:52 2022] GET /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901 => generated 1808 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 21 09:38:52.990803 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-58d51258-7895-4d8b-af05-4598cdb18fd5 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] 10.222.0.45 "GET /compute/v2.1/servers/0f393a36-e048-4228-a48c-9ed725c3e71c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.066006 Jan 21 09:38:52.992916 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 285/572] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Jan 21 09:38:52 2022] GET /compute/v2.1/servers/0f393a36-e048-4228-a48c-9ed725c3e71c/os-volume_attachments => generated 25 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 21 09:38:53.295665 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-701169f0-b5b4-4f01-99a4-022f0eaa745d tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:38:53.296256 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-701169f0-b5b4-4f01-99a4-022f0eaa745d tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] [instance: 6104a6dc-afee-486a-a867-490dad16c883] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:38:53.305255 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-701169f0-b5b4-4f01-99a4-022f0eaa745d tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:53.308552 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-701169f0-b5b4-4f01-99a4-022f0eaa745d tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:53.309090 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-701169f0-b5b4-4f01-99a4-022f0eaa745d tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:53.310270 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-701169f0-b5b4-4f01-99a4-022f0eaa745d tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:53.556088 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-701169f0-b5b4-4f01-99a4-022f0eaa745d tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498146f6a6814129b393e7084057bfd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db07feb3a43432999da539b6b85fb2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:38:53.564320 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-701169f0-b5b4-4f01-99a4-022f0eaa745d tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] 10.222.0.45 "GET /compute/v2.1/servers/6104a6dc-afee-486a-a867-490dad16c883" status: 200 len: 1319 microversion: 2.1 time: 0.272288 Jan 21 09:38:53.567071 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 288/573] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:38:53 2022] GET /compute/v2.1/servers/6104a6dc-afee-486a-a867-490dad16c883 => generated 1319 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:38:53.951583 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-b43755ab-89ce-4bde-a1f9-a956720a9202 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:38:53.961000 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-b43755ab-89ce-4bde-a1f9-a956720a9202 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] [instance: 4e67b25e-7e65-4975-bafa-fceafcd53647] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:38:53.974126 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-b43755ab-89ce-4bde-a1f9-a956720a9202 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:53.974648 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-b43755ab-89ce-4bde-a1f9-a956720a9202 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:53.975503 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-b43755ab-89ce-4bde-a1f9-a956720a9202 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:53.975962 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-b43755ab-89ce-4bde-a1f9-a956720a9202 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:53.988652 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-ccfd2fa1-afcf-408c-8594-32b80b0773d3 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:38:53.989349 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-ccfd2fa1-afcf-408c-8594-32b80b0773d3 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] [instance: 59ad64a5-af93-44ef-8031-fd2f2d18a901] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:38:54.012785 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-ccfd2fa1-afcf-408c-8594-32b80b0773d3 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:54.012785 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-ccfd2fa1-afcf-408c-8594-32b80b0773d3 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:54.012785 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-ccfd2fa1-afcf-408c-8594-32b80b0773d3 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:54.012785 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-ccfd2fa1-afcf-408c-8594-32b80b0773d3 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:54.262237 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-b43755ab-89ce-4bde-a1f9-a956720a9202 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db87258db1424ce7a8399fdd05efe3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89d1b21ad8471a8a9a82adac2594c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:38:54.264361 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-ccfd2fa1-afcf-408c-8594-32b80b0773d3 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:38:54.276195 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-ccfd2fa1-afcf-408c-8594-32b80b0773d3 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:38:54.277735 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-ccfd2fa1-afcf-408c-8594-32b80b0773d3 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:38:54.278974 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-ccfd2fa1-afcf-408c-8594-32b80b0773d3 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "GET /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901" status: 200 len: 1808 microversion: 2.20 time: 0.295487 Jan 21 09:38:54.279732 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 289/574] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jan 21 09:38:53 2022] GET /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901 => generated 1808 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 21 09:38:54.284716 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-b43755ab-89ce-4bde-a1f9-a956720a9202 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] 10.222.0.45 "GET /compute/v2.1/servers/4e67b25e-7e65-4975-bafa-fceafcd53647" status: 200 len: 1546 microversion: 2.1 time: 0.341699 Jan 21 09:38:54.285642 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 286/575] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:38:53 2022] GET /compute/v2.1/servers/4e67b25e-7e65-4975-bafa-fceafcd53647 => generated 1546 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:38:54.302267 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-59c48633-c592-474b-9a54-44f679f99815 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:38:54.302872 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-59c48633-c592-474b-9a54-44f679f99815 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] [instance: 4e67b25e-7e65-4975-bafa-fceafcd53647] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:38:54.313086 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-59c48633-c592-474b-9a54-44f679f99815 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:54.316294 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-59c48633-c592-474b-9a54-44f679f99815 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:54.316294 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-59c48633-c592-474b-9a54-44f679f99815 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:54.316294 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-59c48633-c592-474b-9a54-44f679f99815 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:54.412175 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.wsgi [None req-59c48633-c592-474b-9a54-44f679f99815 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] HTTP exception thrown: Cannot 'detach_volume' instance 4e67b25e-7e65-4975-bafa-fceafcd53647 while it is in vm_state rescued Jan 21 09:38:54.412829 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-59c48633-c592-474b-9a54-44f679f99815 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Returning 409 to user: Cannot 'detach_volume' instance 4e67b25e-7e65-4975-bafa-fceafcd53647 while it is in vm_state rescued {{(pid=123387) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 21 09:38:54.413824 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-59c48633-c592-474b-9a54-44f679f99815 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] 10.222.0.45 "DELETE /compute/v2.1/servers/4e67b25e-7e65-4975-bafa-fceafcd53647/os-volume_attachments/b2470e40-0bf8-4f16-8413-bc535817e14d" status: 409 len: 152 microversion: 2.1 time: 0.116015 Jan 21 09:38:54.415259 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 290/576] 10.222.0.45 () {58 vars in 1415 bytes} [Fri Jan 21 09:38:54 2022] DELETE /compute/v2.1/servers/4e67b25e-7e65-4975-bafa-fceafcd53647/os-volume_attachments/b2470e40-0bf8-4f16-8413-bc535817e14d => generated 152 bytes in 118 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jan 21 09:38:54.423011 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-988cffdc-f4f3-4583-8c96-19beaea23bd3 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:38:54.423701 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-988cffdc-f4f3-4583-8c96-19beaea23bd3 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] [instance: 4e67b25e-7e65-4975-bafa-fceafcd53647] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:38:54.432228 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-988cffdc-f4f3-4583-8c96-19beaea23bd3 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:54.433059 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-988cffdc-f4f3-4583-8c96-19beaea23bd3 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:54.434367 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-988cffdc-f4f3-4583-8c96-19beaea23bd3 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:54.435245 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-988cffdc-f4f3-4583-8c96-19beaea23bd3 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:54.443554 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-150572e6-28b2-4909-8ef1-c6cf8ba5f542 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:38:54.444095 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-150572e6-28b2-4909-8ef1-c6cf8ba5f542 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] [instance: 0f393a36-e048-4228-a48c-9ed725c3e71c] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:38:54.450520 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-150572e6-28b2-4909-8ef1-c6cf8ba5f542 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:54.450966 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-150572e6-28b2-4909-8ef1-c6cf8ba5f542 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:54.451955 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-150572e6-28b2-4909-8ef1-c6cf8ba5f542 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:54.452394 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-150572e6-28b2-4909-8ef1-c6cf8ba5f542 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:54.484186 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-150572e6-28b2-4909-8ef1-c6cf8ba5f542 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] [instance: 0f393a36-e048-4228-a48c-9ed725c3e71c] Going to try to terminate instance {{(pid=123387) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 21 09:38:54.747636 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-988cffdc-f4f3-4583-8c96-19beaea23bd3 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] 10.222.0.45 "POST /compute/v2.1/servers/4e67b25e-7e65-4975-bafa-fceafcd53647/action" status: 202 len: 0 microversion: 2.1 time: 0.328382 Jan 21 09:38:54.748634 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 287/577] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Jan 21 09:38:54 2022] POST /compute/v2.1/servers/4e67b25e-7e65-4975-bafa-fceafcd53647/action => generated 0 bytes in 330 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 21 09:38:54.755353 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-78e30141-1fbb-4231-ad52-6e92e20d7606 tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:38:54.756513 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-78e30141-1fbb-4231-ad52-6e92e20d7606 tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] [instance: 6104a6dc-afee-486a-a867-490dad16c883] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:38:54.764859 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-78e30141-1fbb-4231-ad52-6e92e20d7606 tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:54.765764 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-78e30141-1fbb-4231-ad52-6e92e20d7606 tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:54.766873 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-78e30141-1fbb-4231-ad52-6e92e20d7606 tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:54.767309 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-78e30141-1fbb-4231-ad52-6e92e20d7606 tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:54.883455 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-150572e6-28b2-4909-8ef1-c6cf8ba5f542 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] 10.222.0.45 "DELETE /compute/v2.1/servers/0f393a36-e048-4228-a48c-9ed725c3e71c" status: 204 len: 0 microversion: 2.1 time: 0.442908 Jan 21 09:38:54.884484 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 291/578] 10.222.0.45 () {58 vars in 1238 bytes} [Fri Jan 21 09:38:54 2022] DELETE /compute/v2.1/servers/0f393a36-e048-4228-a48c-9ed725c3e71c => generated 0 bytes in 446 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 21 09:38:54.891801 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-0a790779-1274-4b11-b050-2b35058624a1 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:38:54.892634 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-0a790779-1274-4b11-b050-2b35058624a1 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] [instance: 4e67b25e-7e65-4975-bafa-fceafcd53647] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:38:54.904623 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-0a790779-1274-4b11-b050-2b35058624a1 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:54.906068 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-0a790779-1274-4b11-b050-2b35058624a1 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:54.911558 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-0a790779-1274-4b11-b050-2b35058624a1 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:54.911558 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-0a790779-1274-4b11-b050-2b35058624a1 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:55.009650 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-78e30141-1fbb-4231-ad52-6e92e20d7606 tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498146f6a6814129b393e7084057bfd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db07feb3a43432999da539b6b85fb2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:38:55.020221 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-78e30141-1fbb-4231-ad52-6e92e20d7606 tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] 10.222.0.45 "GET /compute/v2.1/servers/6104a6dc-afee-486a-a867-490dad16c883" status: 200 len: 1508 microversion: 2.1 time: 0.268342 Jan 21 09:38:55.020833 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 288/579] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:38:54 2022] GET /compute/v2.1/servers/6104a6dc-afee-486a-a867-490dad16c883 => generated 1508 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:38:55.031295 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-24f4d962-40b1-4de9-8a82-b7b09e0e6669 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:38:55.031295 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-24f4d962-40b1-4de9-8a82-b7b09e0e6669 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] [instance: 0f393a36-e048-4228-a48c-9ed725c3e71c] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:38:55.037985 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-24f4d962-40b1-4de9-8a82-b7b09e0e6669 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:55.039059 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-24f4d962-40b1-4de9-8a82-b7b09e0e6669 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:55.040452 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-24f4d962-40b1-4de9-8a82-b7b09e0e6669 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:55.041533 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-24f4d962-40b1-4de9-8a82-b7b09e0e6669 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:55.210235 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-0a790779-1274-4b11-b050-2b35058624a1 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db87258db1424ce7a8399fdd05efe3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89d1b21ad8471a8a9a82adac2594c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:38:55.219507 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-0a790779-1274-4b11-b050-2b35058624a1 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] 10.222.0.45 "GET /compute/v2.1/servers/4e67b25e-7e65-4975-bafa-fceafcd53647" status: 200 len: 1554 microversion: 2.1 time: 0.333311 Jan 21 09:38:55.219880 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 292/580] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:38:54 2022] GET /compute/v2.1/servers/4e67b25e-7e65-4975-bafa-fceafcd53647 => generated 1554 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:38:55.239568 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-ea6ee478-d4c8-458f-9772-580d457e2655 tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c9765ef0-8cc7-40c2-b03d-cad6156ec614", "device": "/dev/sdb"}} {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:38:55.245106 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-ea6ee478-d4c8-458f-9772-580d457e2655 tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] [instance: 6104a6dc-afee-486a-a867-490dad16c883] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:38:55.251270 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-ea6ee478-d4c8-458f-9772-580d457e2655 tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:55.251727 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-ea6ee478-d4c8-458f-9772-580d457e2655 tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:55.253098 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-ea6ee478-d4c8-458f-9772-580d457e2655 tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:55.253876 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-ea6ee478-d4c8-458f-9772-580d457e2655 tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:55.381276 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-24f4d962-40b1-4de9-8a82-b7b09e0e6669 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7b2c14d9444d65ab7a874e749671bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3390729231b409e9a83376b428c1a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:38:55.393907 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-24f4d962-40b1-4de9-8a82-b7b09e0e6669 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] 10.222.0.45 "GET /compute/v2.1/servers/0f393a36-e048-4228-a48c-9ed725c3e71c" status: 200 len: 1514 microversion: 2.1 time: 0.371081 Jan 21 09:38:55.408326 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 289/581] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:38:55 2022] GET /compute/v2.1/servers/0f393a36-e048-4228-a48c-9ed725c3e71c => generated 1514 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:38:55.420153 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-a5b42d4f-a3fb-44c8-852a-4b715006209e tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:38:55.423800 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-a5b42d4f-a3fb-44c8-852a-4b715006209e tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] [instance: 59ad64a5-af93-44ef-8031-fd2f2d18a901] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:38:55.431600 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-a5b42d4f-a3fb-44c8-852a-4b715006209e tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:55.432186 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-a5b42d4f-a3fb-44c8-852a-4b715006209e tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:55.441491 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-a5b42d4f-a3fb-44c8-852a-4b715006209e tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:55.442113 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-a5b42d4f-a3fb-44c8-852a-4b715006209e tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:55.755421 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-a5b42d4f-a3fb-44c8-852a-4b715006209e tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:38:55.770574 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-a5b42d4f-a3fb-44c8-852a-4b715006209e tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:38:55.772535 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-a5b42d4f-a3fb-44c8-852a-4b715006209e tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:38:55.774187 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-a5b42d4f-a3fb-44c8-852a-4b715006209e tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "GET /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901" status: 200 len: 1808 microversion: 2.20 time: 0.364828 Jan 21 09:38:55.775436 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 290/582] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jan 21 09:38:55 2022] GET /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901 => generated 1808 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 21 09:38:56.089988 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-ea6ee478-d4c8-458f-9772-580d457e2655 tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] 10.222.0.45 "POST /compute/v2.1/servers/6104a6dc-afee-486a-a867-490dad16c883/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.858923 Jan 21 09:38:56.091302 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 293/583] 10.222.0.45 () {60 vars in 1322 bytes} [Fri Jan 21 09:38:55 2022] POST /compute/v2.1/servers/6104a6dc-afee-486a-a867-490dad16c883/os-volume_attachments => generated 194 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 09:38:56.236839 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-23ba1ab7-33c8-4a8d-9c29-b6af588a5d51 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:38:56.243267 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-23ba1ab7-33c8-4a8d-9c29-b6af588a5d51 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] [instance: 4e67b25e-7e65-4975-bafa-fceafcd53647] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:38:56.274507 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-23ba1ab7-33c8-4a8d-9c29-b6af588a5d51 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:56.276491 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-23ba1ab7-33c8-4a8d-9c29-b6af588a5d51 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:56.286839 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-23ba1ab7-33c8-4a8d-9c29-b6af588a5d51 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:56.289051 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-23ba1ab7-33c8-4a8d-9c29-b6af588a5d51 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:56.412546 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-b479db10-ddf3-4dbc-a9c7-939a64a59f31 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:38:56.413623 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-b479db10-ddf3-4dbc-a9c7-939a64a59f31 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] [instance: 0f393a36-e048-4228-a48c-9ed725c3e71c] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:38:56.424024 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-b479db10-ddf3-4dbc-a9c7-939a64a59f31 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:56.426882 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-b479db10-ddf3-4dbc-a9c7-939a64a59f31 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:56.428443 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-b479db10-ddf3-4dbc-a9c7-939a64a59f31 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:56.430915 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-b479db10-ddf3-4dbc-a9c7-939a64a59f31 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:56.465850 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-23ba1ab7-33c8-4a8d-9c29-b6af588a5d51 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db87258db1424ce7a8399fdd05efe3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89d1b21ad8471a8a9a82adac2594c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:38:56.475733 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-23ba1ab7-33c8-4a8d-9c29-b6af588a5d51 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] 10.222.0.45 "GET /compute/v2.1/servers/4e67b25e-7e65-4975-bafa-fceafcd53647" status: 200 len: 1554 microversion: 2.1 time: 0.243197 Jan 21 09:38:56.476856 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 291/584] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:38:56 2022] GET /compute/v2.1/servers/4e67b25e-7e65-4975-bafa-fceafcd53647 => generated 1554 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:38:56.723675 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-b479db10-ddf3-4dbc-a9c7-939a64a59f31 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7b2c14d9444d65ab7a874e749671bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3390729231b409e9a83376b428c1a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:38:56.732174 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-b479db10-ddf3-4dbc-a9c7-939a64a59f31 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] 10.222.0.45 "GET /compute/v2.1/servers/0f393a36-e048-4228-a48c-9ed725c3e71c" status: 200 len: 1514 microversion: 2.1 time: 0.324936 Jan 21 09:38:56.743557 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 294/585] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:38:56 2022] GET /compute/v2.1/servers/0f393a36-e048-4228-a48c-9ed725c3e71c => generated 1514 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:38:56.804847 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-3e3483fc-4522-46c1-9c5f-aeaf9f4dec95 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:38:56.805499 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-3e3483fc-4522-46c1-9c5f-aeaf9f4dec95 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] [instance: 59ad64a5-af93-44ef-8031-fd2f2d18a901] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:38:56.822090 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-3e3483fc-4522-46c1-9c5f-aeaf9f4dec95 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:56.822540 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-3e3483fc-4522-46c1-9c5f-aeaf9f4dec95 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:56.823345 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-3e3483fc-4522-46c1-9c5f-aeaf9f4dec95 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:56.823785 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-3e3483fc-4522-46c1-9c5f-aeaf9f4dec95 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:57.107965 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-3e3483fc-4522-46c1-9c5f-aeaf9f4dec95 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:38:57.118527 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-3e3483fc-4522-46c1-9c5f-aeaf9f4dec95 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:38:57.121659 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-3e3483fc-4522-46c1-9c5f-aeaf9f4dec95 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:38:57.123345 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-3e3483fc-4522-46c1-9c5f-aeaf9f4dec95 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "GET /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901" status: 200 len: 1808 microversion: 2.20 time: 0.322824 Jan 21 09:38:57.124160 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 292/586] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jan 21 09:38:56 2022] GET /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901 => generated 1808 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 21 09:38:57.495443 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-066817dd-d7f0-46b5-aa36-3269e8379d3d tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:38:57.497644 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-066817dd-d7f0-46b5-aa36-3269e8379d3d tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] [instance: 4e67b25e-7e65-4975-bafa-fceafcd53647] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:38:57.508010 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-066817dd-d7f0-46b5-aa36-3269e8379d3d tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:57.510609 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-066817dd-d7f0-46b5-aa36-3269e8379d3d tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:57.513994 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-066817dd-d7f0-46b5-aa36-3269e8379d3d tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:57.514712 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-066817dd-d7f0-46b5-aa36-3269e8379d3d tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:57.680220 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-066817dd-d7f0-46b5-aa36-3269e8379d3d tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db87258db1424ce7a8399fdd05efe3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89d1b21ad8471a8a9a82adac2594c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:38:57.688866 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-066817dd-d7f0-46b5-aa36-3269e8379d3d tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] 10.222.0.45 "GET /compute/v2.1/servers/4e67b25e-7e65-4975-bafa-fceafcd53647" status: 200 len: 1554 microversion: 2.1 time: 0.198035 Jan 21 09:38:57.690597 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 295/587] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:38:57 2022] GET /compute/v2.1/servers/4e67b25e-7e65-4975-bafa-fceafcd53647 => generated 1554 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:38:57.754765 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-a971a8e4-5d35-434e-8d44-13fc69b21112 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:38:57.756219 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-a971a8e4-5d35-434e-8d44-13fc69b21112 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] [instance: 0f393a36-e048-4228-a48c-9ed725c3e71c] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:38:57.766781 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-a971a8e4-5d35-434e-8d44-13fc69b21112 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:57.770424 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-a971a8e4-5d35-434e-8d44-13fc69b21112 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:57.772538 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-a971a8e4-5d35-434e-8d44-13fc69b21112 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:57.773770 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-a971a8e4-5d35-434e-8d44-13fc69b21112 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:57.980770 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-a971a8e4-5d35-434e-8d44-13fc69b21112 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7b2c14d9444d65ab7a874e749671bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3390729231b409e9a83376b428c1a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:38:57.994160 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-a971a8e4-5d35-434e-8d44-13fc69b21112 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] 10.222.0.45 "GET /compute/v2.1/servers/0f393a36-e048-4228-a48c-9ed725c3e71c" status: 200 len: 1514 microversion: 2.1 time: 0.244103 Jan 21 09:38:58.007030 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 293/588] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:38:57 2022] GET /compute/v2.1/servers/0f393a36-e048-4228-a48c-9ed725c3e71c => generated 1514 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:38:58.142066 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-726fd727-3f12-4967-b09a-eb5becd5e804 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:38:58.142780 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-726fd727-3f12-4967-b09a-eb5becd5e804 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] [instance: 59ad64a5-af93-44ef-8031-fd2f2d18a901] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:38:58.159468 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-726fd727-3f12-4967-b09a-eb5becd5e804 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:58.163662 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-726fd727-3f12-4967-b09a-eb5becd5e804 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:58.163662 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-726fd727-3f12-4967-b09a-eb5becd5e804 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:58.163662 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-726fd727-3f12-4967-b09a-eb5becd5e804 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:58.372432 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-726fd727-3f12-4967-b09a-eb5becd5e804 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:38:58.397778 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-726fd727-3f12-4967-b09a-eb5becd5e804 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:38:58.399945 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-726fd727-3f12-4967-b09a-eb5becd5e804 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:38:58.401180 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-726fd727-3f12-4967-b09a-eb5becd5e804 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "GET /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901" status: 200 len: 1808 microversion: 2.20 time: 0.263093 Jan 21 09:38:58.407496 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 296/589] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jan 21 09:38:58 2022] GET /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901 => generated 1808 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 21 09:38:58.708715 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-12c11c7f-0969-42cc-aaaf-5bf94852adb8 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:38:58.709287 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-12c11c7f-0969-42cc-aaaf-5bf94852adb8 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] [instance: 4e67b25e-7e65-4975-bafa-fceafcd53647] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:38:58.717683 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-12c11c7f-0969-42cc-aaaf-5bf94852adb8 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:58.718130 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-12c11c7f-0969-42cc-aaaf-5bf94852adb8 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:58.718931 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-12c11c7f-0969-42cc-aaaf-5bf94852adb8 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:58.719423 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-12c11c7f-0969-42cc-aaaf-5bf94852adb8 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:58.919379 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-12c11c7f-0969-42cc-aaaf-5bf94852adb8 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db87258db1424ce7a8399fdd05efe3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89d1b21ad8471a8a9a82adac2594c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:38:58.931782 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-12c11c7f-0969-42cc-aaaf-5bf94852adb8 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] 10.222.0.45 "GET /compute/v2.1/servers/4e67b25e-7e65-4975-bafa-fceafcd53647" status: 200 len: 1554 microversion: 2.1 time: 0.227874 Jan 21 09:38:58.941733 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 294/590] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:38:58 2022] GET /compute/v2.1/servers/4e67b25e-7e65-4975-bafa-fceafcd53647 => generated 1554 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:38:59.013475 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-08a94187-4732-495f-b235-0cb58eb5809b tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:38:59.022276 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-08a94187-4732-495f-b235-0cb58eb5809b tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] [instance: 0f393a36-e048-4228-a48c-9ed725c3e71c] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:38:59.022276 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-08a94187-4732-495f-b235-0cb58eb5809b tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:59.022769 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-08a94187-4732-495f-b235-0cb58eb5809b tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:59.024226 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-08a94187-4732-495f-b235-0cb58eb5809b tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:59.024942 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-08a94187-4732-495f-b235-0cb58eb5809b tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:59.265182 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-08a94187-4732-495f-b235-0cb58eb5809b tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7b2c14d9444d65ab7a874e749671bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3390729231b409e9a83376b428c1a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:38:59.291113 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-08a94187-4732-495f-b235-0cb58eb5809b tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] 10.222.0.45 "GET /compute/v2.1/servers/0f393a36-e048-4228-a48c-9ed725c3e71c" status: 200 len: 1514 microversion: 2.1 time: 0.281554 Jan 21 09:38:59.332373 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 297/591] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:38:59 2022] GET /compute/v2.1/servers/0f393a36-e048-4228-a48c-9ed725c3e71c => generated 1514 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:38:59.420145 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-fb0f3862-09ad-48bb-a007-a04252dff9c8 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:38:59.421719 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-fb0f3862-09ad-48bb-a007-a04252dff9c8 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] [instance: 59ad64a5-af93-44ef-8031-fd2f2d18a901] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:38:59.432772 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-fb0f3862-09ad-48bb-a007-a04252dff9c8 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:59.433566 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-fb0f3862-09ad-48bb-a007-a04252dff9c8 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:59.434572 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-fb0f3862-09ad-48bb-a007-a04252dff9c8 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:59.435746 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-fb0f3862-09ad-48bb-a007-a04252dff9c8 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:59.699195 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-fb0f3862-09ad-48bb-a007-a04252dff9c8 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:38:59.711161 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-fb0f3862-09ad-48bb-a007-a04252dff9c8 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:38:59.747278 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-fb0f3862-09ad-48bb-a007-a04252dff9c8 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:38:59.747278 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-fb0f3862-09ad-48bb-a007-a04252dff9c8 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "GET /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901" status: 200 len: 1808 microversion: 2.20 time: 0.298479 Jan 21 09:38:59.747278 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 295/592] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jan 21 09:38:59 2022] GET /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901 => generated 1808 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 21 09:38:59.950886 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-bd9e1555-3bbf-4703-a46c-81656ccf51ab tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:38:59.951930 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-bd9e1555-3bbf-4703-a46c-81656ccf51ab tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] [instance: 4e67b25e-7e65-4975-bafa-fceafcd53647] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:38:59.964202 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-bd9e1555-3bbf-4703-a46c-81656ccf51ab tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:59.964656 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-bd9e1555-3bbf-4703-a46c-81656ccf51ab tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:38:59.965498 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-bd9e1555-3bbf-4703-a46c-81656ccf51ab tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:38:59.965932 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-bd9e1555-3bbf-4703-a46c-81656ccf51ab tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:39:00.236981 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-bd9e1555-3bbf-4703-a46c-81656ccf51ab tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db87258db1424ce7a8399fdd05efe3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89d1b21ad8471a8a9a82adac2594c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:39:00.248943 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-bd9e1555-3bbf-4703-a46c-81656ccf51ab tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] 10.222.0.45 "GET /compute/v2.1/servers/4e67b25e-7e65-4975-bafa-fceafcd53647" status: 200 len: 1554 microversion: 2.1 time: 0.301876 Jan 21 09:39:00.250213 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 298/593] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:38:59 2022] GET /compute/v2.1/servers/4e67b25e-7e65-4975-bafa-fceafcd53647 => generated 1554 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:39:00.344131 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-1f536054-71f2-45b3-aee8-4a76bf951762 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:39:00.345301 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-1f536054-71f2-45b3-aee8-4a76bf951762 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] [instance: 0f393a36-e048-4228-a48c-9ed725c3e71c] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:39:00.359749 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-1f536054-71f2-45b3-aee8-4a76bf951762 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:39:00.360929 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-1f536054-71f2-45b3-aee8-4a76bf951762 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:39:00.363043 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-1f536054-71f2-45b3-aee8-4a76bf951762 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:39:00.363945 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-1f536054-71f2-45b3-aee8-4a76bf951762 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:39:00.581740 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-1f536054-71f2-45b3-aee8-4a76bf951762 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7b2c14d9444d65ab7a874e749671bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3390729231b409e9a83376b428c1a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:39:00.596193 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-1f536054-71f2-45b3-aee8-4a76bf951762 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] 10.222.0.45 "GET /compute/v2.1/servers/0f393a36-e048-4228-a48c-9ed725c3e71c" status: 200 len: 1514 microversion: 2.1 time: 0.255311 Jan 21 09:39:00.602142 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 296/594] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:39:00 2022] GET /compute/v2.1/servers/0f393a36-e048-4228-a48c-9ed725c3e71c => generated 1514 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:39:00.756483 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-0fe19dba-9762-4813-99ff-59a308558990 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:39:00.756748 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-0fe19dba-9762-4813-99ff-59a308558990 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] [instance: 59ad64a5-af93-44ef-8031-fd2f2d18a901] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:39:00.764136 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-0fe19dba-9762-4813-99ff-59a308558990 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:39:00.766859 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-0fe19dba-9762-4813-99ff-59a308558990 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:39:00.768665 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-0fe19dba-9762-4813-99ff-59a308558990 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:39:00.769481 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-0fe19dba-9762-4813-99ff-59a308558990 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:39:01.087311 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-0fe19dba-9762-4813-99ff-59a308558990 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:39:01.108052 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-0fe19dba-9762-4813-99ff-59a308558990 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:39:01.115026 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-0fe19dba-9762-4813-99ff-59a308558990 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:39:01.117623 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-0fe19dba-9762-4813-99ff-59a308558990 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "GET /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901" status: 200 len: 1808 microversion: 2.20 time: 0.369357 Jan 21 09:39:01.118992 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 299/595] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jan 21 09:39:00 2022] GET /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901 => generated 1808 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 21 09:39:01.269947 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-9fe461ca-c4e9-42b3-8f81-fd99c1dbba5c tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:39:01.270808 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-9fe461ca-c4e9-42b3-8f81-fd99c1dbba5c tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] [instance: 4e67b25e-7e65-4975-bafa-fceafcd53647] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:39:01.287127 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-9fe461ca-c4e9-42b3-8f81-fd99c1dbba5c tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:39:01.288228 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-9fe461ca-c4e9-42b3-8f81-fd99c1dbba5c tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:39:01.290611 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-9fe461ca-c4e9-42b3-8f81-fd99c1dbba5c tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:39:01.292160 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-9fe461ca-c4e9-42b3-8f81-fd99c1dbba5c tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:39:01.513715 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-9fe461ca-c4e9-42b3-8f81-fd99c1dbba5c tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db87258db1424ce7a8399fdd05efe3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89d1b21ad8471a8a9a82adac2594c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:39:01.524249 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-9fe461ca-c4e9-42b3-8f81-fd99c1dbba5c tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] 10.222.0.45 "GET /compute/v2.1/servers/4e67b25e-7e65-4975-bafa-fceafcd53647" status: 200 len: 1554 microversion: 2.1 time: 0.261463 Jan 21 09:39:01.525605 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 297/596] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:39:01 2022] GET /compute/v2.1/servers/4e67b25e-7e65-4975-bafa-fceafcd53647 => generated 1554 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:39:01.612555 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-08c7f9d6-8890-477a-8536-f6d2107d6dbe tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:39:01.614766 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-08c7f9d6-8890-477a-8536-f6d2107d6dbe tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] [instance: 0f393a36-e048-4228-a48c-9ed725c3e71c] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:39:01.634707 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-08c7f9d6-8890-477a-8536-f6d2107d6dbe tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:39:01.636061 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-08c7f9d6-8890-477a-8536-f6d2107d6dbe tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:39:01.641677 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-08c7f9d6-8890-477a-8536-f6d2107d6dbe tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:39:01.642513 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-08c7f9d6-8890-477a-8536-f6d2107d6dbe tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:39:01.970599 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-08c7f9d6-8890-477a-8536-f6d2107d6dbe tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7b2c14d9444d65ab7a874e749671bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3390729231b409e9a83376b428c1a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:39:02.002854 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-08c7f9d6-8890-477a-8536-f6d2107d6dbe tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] 10.222.0.45 "GET /compute/v2.1/servers/0f393a36-e048-4228-a48c-9ed725c3e71c" status: 200 len: 1514 microversion: 2.1 time: 0.395783 Jan 21 09:39:02.014700 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 300/597] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:39:01 2022] GET /compute/v2.1/servers/0f393a36-e048-4228-a48c-9ed725c3e71c => generated 1514 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:39:02.138034 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-edec24e9-08f4-46b6-830c-1973c438c33d tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:39:02.138774 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-edec24e9-08f4-46b6-830c-1973c438c33d tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] [instance: 59ad64a5-af93-44ef-8031-fd2f2d18a901] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:39:02.151066 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-edec24e9-08f4-46b6-830c-1973c438c33d tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:39:02.151549 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-edec24e9-08f4-46b6-830c-1973c438c33d tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:39:02.152436 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-edec24e9-08f4-46b6-830c-1973c438c33d tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:39:02.152916 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-edec24e9-08f4-46b6-830c-1973c438c33d tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:39:02.362933 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-edec24e9-08f4-46b6-830c-1973c438c33d tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:39:02.372392 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-edec24e9-08f4-46b6-830c-1973c438c33d tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:39:02.383314 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-edec24e9-08f4-46b6-830c-1973c438c33d tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:39:02.385640 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-edec24e9-08f4-46b6-830c-1973c438c33d tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "GET /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901" status: 200 len: 1808 microversion: 2.20 time: 0.251755 Jan 21 09:39:02.386393 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 298/598] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jan 21 09:39:02 2022] GET /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901 => generated 1808 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 21 09:39:02.546202 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-d0364980-9bce-4b4f-a5b4-954435b37c88 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:39:02.546982 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-d0364980-9bce-4b4f-a5b4-954435b37c88 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] [instance: 4e67b25e-7e65-4975-bafa-fceafcd53647] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:39:02.576300 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-d0364980-9bce-4b4f-a5b4-954435b37c88 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:39:02.576944 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-d0364980-9bce-4b4f-a5b4-954435b37c88 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:39:02.578138 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-d0364980-9bce-4b4f-a5b4-954435b37c88 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:39:02.578773 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-d0364980-9bce-4b4f-a5b4-954435b37c88 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:39:03.023589 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-0fef0e6d-06cf-4d2e-80aa-0f0ea368b2e6 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:39:03.025223 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-0fef0e6d-06cf-4d2e-80aa-0f0ea368b2e6 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] [instance: 0f393a36-e048-4228-a48c-9ed725c3e71c] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:39:03.040169 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-0fef0e6d-06cf-4d2e-80aa-0f0ea368b2e6 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:39:03.044712 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-0fef0e6d-06cf-4d2e-80aa-0f0ea368b2e6 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:39:03.044712 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-0fef0e6d-06cf-4d2e-80aa-0f0ea368b2e6 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:39:03.044712 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-0fef0e6d-06cf-4d2e-80aa-0f0ea368b2e6 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:39:03.109434 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-d0364980-9bce-4b4f-a5b4-954435b37c88 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db87258db1424ce7a8399fdd05efe3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89d1b21ad8471a8a9a82adac2594c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:39:03.126539 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-d0364980-9bce-4b4f-a5b4-954435b37c88 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] 10.222.0.45 "GET /compute/v2.1/servers/4e67b25e-7e65-4975-bafa-fceafcd53647" status: 200 len: 1554 microversion: 2.1 time: 0.586043 Jan 21 09:39:03.137892 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 301/599] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:39:02 2022] GET /compute/v2.1/servers/4e67b25e-7e65-4975-bafa-fceafcd53647 => generated 1554 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:39:03.411088 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-026c6715-6d2c-4897-89e2-36124acbbb68 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:39:03.411749 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-026c6715-6d2c-4897-89e2-36124acbbb68 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] [instance: 59ad64a5-af93-44ef-8031-fd2f2d18a901] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:39:03.432558 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-026c6715-6d2c-4897-89e2-36124acbbb68 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:39:03.432558 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-026c6715-6d2c-4897-89e2-36124acbbb68 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:39:03.432558 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-026c6715-6d2c-4897-89e2-36124acbbb68 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:39:03.433446 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-026c6715-6d2c-4897-89e2-36124acbbb68 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:39:04.218650 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-0fef0e6d-06cf-4d2e-80aa-0f0ea368b2e6 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7b2c14d9444d65ab7a874e749671bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3390729231b409e9a83376b428c1a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:39:04.228543 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-0fef0e6d-06cf-4d2e-80aa-0f0ea368b2e6 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] 10.222.0.45 "GET /compute/v2.1/servers/0f393a36-e048-4228-a48c-9ed725c3e71c" status: 200 len: 1514 microversion: 2.1 time: 1.208774 Jan 21 09:39:04.240562 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 299/600] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:39:03 2022] GET /compute/v2.1/servers/0f393a36-e048-4228-a48c-9ed725c3e71c => generated 1514 bytes in 1223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:39:04.246038 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-94182365-ded4-491a-aa93-4d76708f4ff6 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:39:04.252052 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-94182365-ded4-491a-aa93-4d76708f4ff6 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] [instance: 4e67b25e-7e65-4975-bafa-fceafcd53647] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:39:04.254413 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-94182365-ded4-491a-aa93-4d76708f4ff6 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:39:04.255056 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-94182365-ded4-491a-aa93-4d76708f4ff6 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:39:04.261056 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-94182365-ded4-491a-aa93-4d76708f4ff6 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:39:04.263905 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-94182365-ded4-491a-aa93-4d76708f4ff6 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:39:04.419992 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-026c6715-6d2c-4897-89e2-36124acbbb68 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:39:04.437138 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-026c6715-6d2c-4897-89e2-36124acbbb68 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:39:04.443547 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-026c6715-6d2c-4897-89e2-36124acbbb68 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:39:04.457358 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-026c6715-6d2c-4897-89e2-36124acbbb68 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "GET /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901" status: 200 len: 1808 microversion: 2.20 time: 1.040554 Jan 21 09:39:04.463019 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 302/601] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jan 21 09:39:03 2022] GET /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901 => generated 1808 bytes in 1059 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 21 09:39:04.470778 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [req-feee7142-fd56-4558-afc3-1a58f67b172b req-2890d026-5dfb-4a3f-bf80-e4e0bc7b3f24 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f393a36-e048-4228-a48c-9ed725c3e71c", "name": "network-vif-deleted", "tag": "3a1c611f-ef10-4e62-a802-09f927e4a0d9"}]} {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:39:04.479789 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 21 09:39:04.479789 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: warnings.warn(msg) Jan 21 09:39:04.493654 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [req-feee7142-fd56-4558-afc3-1a58f67b172b req-2890d026-5dfb-4a3f-bf80-e4e0bc7b3f24 service nova] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:39:04.494461 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [req-feee7142-fd56-4558-afc3-1a58f67b172b req-2890d026-5dfb-4a3f-bf80-e4e0bc7b3f24 service nova] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:39:04.510637 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.compute.server_external_events [req-feee7142-fd56-4558-afc3-1a58f67b172b req-2890d026-5dfb-4a3f-bf80-e4e0bc7b3f24 service nova] Creating event network-vif-deleted:3a1c611f-ef10-4e62-a802-09f927e4a0d9 for instance 0f393a36-e048-4228-a48c-9ed725c3e71c on hv-cinder-80403 Jan 21 09:39:04.516201 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [req-feee7142-fd56-4558-afc3-1a58f67b172b req-2890d026-5dfb-4a3f-bf80-e4e0bc7b3f24 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051580 Jan 21 09:39:04.519831 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 303/602] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Jan 21 09:39:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 09:39:04.585921 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-94182365-ded4-491a-aa93-4d76708f4ff6 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db87258db1424ce7a8399fdd05efe3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89d1b21ad8471a8a9a82adac2594c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:39:04.620127 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-94182365-ded4-491a-aa93-4d76708f4ff6 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] 10.222.0.45 "GET /compute/v2.1/servers/4e67b25e-7e65-4975-bafa-fceafcd53647" status: 200 len: 1560 microversion: 2.1 time: 0.378007 Jan 21 09:39:04.639588 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 300/603] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:39:04 2022] GET /compute/v2.1/servers/4e67b25e-7e65-4975-bafa-fceafcd53647 => generated 1560 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:39:04.772441 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-f4709faf-1c2c-4efb-bab6-7a964056a654 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:39:04.773349 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-f4709faf-1c2c-4efb-bab6-7a964056a654 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] [instance: 4e67b25e-7e65-4975-bafa-fceafcd53647] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:39:04.782988 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-f4709faf-1c2c-4efb-bab6-7a964056a654 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:39:04.784343 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-f4709faf-1c2c-4efb-bab6-7a964056a654 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:39:04.785490 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-f4709faf-1c2c-4efb-bab6-7a964056a654 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:39:04.786306 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-f4709faf-1c2c-4efb-bab6-7a964056a654 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:39:04.871639 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-bd5c24ed-e899-4337-92cb-68792fa03f32 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:39:04.873384 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-bd5c24ed-e899-4337-92cb-68792fa03f32 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] [instance: 750f8ae5-b267-4b76-bb13-170071722932] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:39:04.886113 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-bd5c24ed-e899-4337-92cb-68792fa03f32 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:39:04.886113 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-bd5c24ed-e899-4337-92cb-68792fa03f32 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:39:04.886113 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-bd5c24ed-e899-4337-92cb-68792fa03f32 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:39:04.886589 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-bd5c24ed-e899-4337-92cb-68792fa03f32 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:39:04.900738 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.objects.instance [None req-f4709faf-1c2c-4efb-bab6-7a964056a654 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lazy-loading 'services' on Instance uuid 4e67b25e-7e65-4975-bafa-fceafcd53647 {{(pid=123387) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 21 09:39:05.116913 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-bd5c24ed-e899-4337-92cb-68792fa03f32 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a8838f167743678110ca0a9d5a2484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10ed49573f464cc18794b94fd1c115ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:39:05.129229 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-bd5c24ed-e899-4337-92cb-68792fa03f32 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] 10.222.0.45 "GET /compute/v2.1/servers/750f8ae5-b267-4b76-bb13-170071722932" status: 200 len: 1593 microversion: 2.1 time: 0.264929 Jan 21 09:39:05.145883 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 301/604] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:39:04 2022] GET /compute/v2.1/servers/750f8ae5-b267-4b76-bb13-170071722932 => generated 1593 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 09:39:05.176238 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-f4709faf-1c2c-4efb-bab6-7a964056a654 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] 10.222.0.45 "DELETE /compute/v2.1/servers/4e67b25e-7e65-4975-bafa-fceafcd53647/os-volume_attachments/b2470e40-0bf8-4f16-8413-bc535817e14d" status: 202 len: 0 microversion: 2.1 time: 0.410429 Jan 21 09:39:05.177035 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 304/605] 10.222.0.45 () {58 vars in 1415 bytes} [Fri Jan 21 09:39:04 2022] DELETE /compute/v2.1/servers/4e67b25e-7e65-4975-bafa-fceafcd53647/os-volume_attachments/b2470e40-0bf8-4f16-8413-bc535817e14d => generated 0 bytes in 413 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 21 09:39:05.185451 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-7a577af3-cc7e-4e4c-bb86-a3779a162c57 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:39:05.191579 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-7a577af3-cc7e-4e4c-bb86-a3779a162c57 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] [instance: 4e67b25e-7e65-4975-bafa-fceafcd53647] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:39:05.198180 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-7a577af3-cc7e-4e4c-bb86-a3779a162c57 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:39:05.198873 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-7a577af3-cc7e-4e4c-bb86-a3779a162c57 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:39:05.199736 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-7a577af3-cc7e-4e4c-bb86-a3779a162c57 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:39:05.200193 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-7a577af3-cc7e-4e4c-bb86-a3779a162c57 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:39:05.235425 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-7a577af3-cc7e-4e4c-bb86-a3779a162c57 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] 10.222.0.45 "GET /compute/v2.1/servers/4e67b25e-7e65-4975-bafa-fceafcd53647/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053903 Jan 21 09:39:05.237157 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 302/606] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Jan 21 09:39:05 2022] GET /compute/v2.1/servers/4e67b25e-7e65-4975-bafa-fceafcd53647/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 21 09:39:05.247768 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-014fb192-4046-47ea-85ca-d41206da2c08 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:39:05.249095 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-014fb192-4046-47ea-85ca-d41206da2c08 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] [instance: 0f393a36-e048-4228-a48c-9ed725c3e71c] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:39:05.256337 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-014fb192-4046-47ea-85ca-d41206da2c08 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:39:05.265985 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-014fb192-4046-47ea-85ca-d41206da2c08 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:39:05.266321 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-014fb192-4046-47ea-85ca-d41206da2c08 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:39:05.266834 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-014fb192-4046-47ea-85ca-d41206da2c08 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:39:05.366271 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-014fb192-4046-47ea-85ca-d41206da2c08 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:39:05.366820 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-014fb192-4046-47ea-85ca-d41206da2c08 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:39:05.367346 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.objects.instance [None req-014fb192-4046-47ea-85ca-d41206da2c08 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lazy-loading 'fault' on Instance uuid 0f393a36-e048-4228-a48c-9ed725c3e71c {{(pid=123387) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 21 09:39:05.470016 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-be0e052e-0892-4b99-9bd0-7c4d110bff2d tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:39:05.470630 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-be0e052e-0892-4b99-9bd0-7c4d110bff2d tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] [instance: 59ad64a5-af93-44ef-8031-fd2f2d18a901] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:39:05.484951 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-be0e052e-0892-4b99-9bd0-7c4d110bff2d tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:39:05.485424 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-be0e052e-0892-4b99-9bd0-7c4d110bff2d tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:39:05.486575 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-be0e052e-0892-4b99-9bd0-7c4d110bff2d tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:39:05.487200 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-be0e052e-0892-4b99-9bd0-7c4d110bff2d tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:39:05.511546 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-014fb192-4046-47ea-85ca-d41206da2c08 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7b2c14d9444d65ab7a874e749671bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3390729231b409e9a83376b428c1a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:39:05.527852 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-014fb192-4046-47ea-85ca-d41206da2c08 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] 10.222.0.45 "GET /compute/v2.1/servers/0f393a36-e048-4228-a48c-9ed725c3e71c" status: 200 len: 1308 microversion: 2.1 time: 0.284466 Jan 21 09:39:05.534528 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 305/607] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:39:05 2022] GET /compute/v2.1/servers/0f393a36-e048-4228-a48c-9ed725c3e71c => generated 1308 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:39:05.845709 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-be0e052e-0892-4b99-9bd0-7c4d110bff2d tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:39:05.867062 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-be0e052e-0892-4b99-9bd0-7c4d110bff2d tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:39:05.868913 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-be0e052e-0892-4b99-9bd0-7c4d110bff2d tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:39:05.872285 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-be0e052e-0892-4b99-9bd0-7c4d110bff2d tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "GET /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901" status: 200 len: 1808 microversion: 2.20 time: 0.405934 Jan 21 09:39:05.872861 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 303/608] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jan 21 09:39:05 2022] GET /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901 => generated 1808 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 21 09:39:06.248996 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-2d0f4436-cb37-40e5-b503-d37c4bd3b674 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:39:06.250028 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-2d0f4436-cb37-40e5-b503-d37c4bd3b674 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] [instance: 4e67b25e-7e65-4975-bafa-fceafcd53647] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:39:06.264324 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-2d0f4436-cb37-40e5-b503-d37c4bd3b674 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:39:06.265161 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-2d0f4436-cb37-40e5-b503-d37c4bd3b674 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:39:06.266186 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-2d0f4436-cb37-40e5-b503-d37c4bd3b674 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:39:06.270174 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-2d0f4436-cb37-40e5-b503-d37c4bd3b674 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:39:06.355666 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-2d0f4436-cb37-40e5-b503-d37c4bd3b674 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] 10.222.0.45 "GET /compute/v2.1/servers/4e67b25e-7e65-4975-bafa-fceafcd53647/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.110432 Jan 21 09:39:06.358115 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 306/609] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Jan 21 09:39:06 2022] GET /compute/v2.1/servers/4e67b25e-7e65-4975-bafa-fceafcd53647/os-volume_attachments => generated 197 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 09:39:06.554842 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-e24fc8ba-f5eb-42d7-925e-e9f83ea59840 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:39:06.555780 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-e24fc8ba-f5eb-42d7-925e-e9f83ea59840 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] [instance: 0f393a36-e048-4228-a48c-9ed725c3e71c] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:39:06.589046 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-e24fc8ba-f5eb-42d7-925e-e9f83ea59840 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:39:06.599543 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-e24fc8ba-f5eb-42d7-925e-e9f83ea59840 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:39:06.601779 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-e24fc8ba-f5eb-42d7-925e-e9f83ea59840 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:39:06.604121 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-e24fc8ba-f5eb-42d7-925e-e9f83ea59840 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:39:06.651776 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.wsgi [None req-e24fc8ba-f5eb-42d7-925e-e9f83ea59840 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] HTTP exception thrown: Instance 0f393a36-e048-4228-a48c-9ed725c3e71c could not be found. Jan 21 09:39:06.655938 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-e24fc8ba-f5eb-42d7-925e-e9f83ea59840 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Returning 404 to user: Instance 0f393a36-e048-4228-a48c-9ed725c3e71c could not be found. {{(pid=123386) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 21 09:39:06.660604 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-e24fc8ba-f5eb-42d7-925e-e9f83ea59840 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] 10.222.0.45 "GET /compute/v2.1/servers/0f393a36-e048-4228-a48c-9ed725c3e71c" status: 404 len: 111 microversion: 2.1 time: 0.112656 Jan 21 09:39:06.662397 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 304/610] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:39:06 2022] GET /compute/v2.1/servers/0f393a36-e048-4228-a48c-9ed725c3e71c => generated 111 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 21 09:39:06.911654 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-adff9bbb-4333-4b04-bd14-99c636dead9b tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:39:06.911654 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-adff9bbb-4333-4b04-bd14-99c636dead9b tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] [instance: 59ad64a5-af93-44ef-8031-fd2f2d18a901] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:39:06.920971 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-adff9bbb-4333-4b04-bd14-99c636dead9b tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:39:06.922006 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-adff9bbb-4333-4b04-bd14-99c636dead9b tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:39:06.923111 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-adff9bbb-4333-4b04-bd14-99c636dead9b tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:39:06.923775 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-adff9bbb-4333-4b04-bd14-99c636dead9b tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:39:07.364794 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-adff9bbb-4333-4b04-bd14-99c636dead9b tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:39:07.371798 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-5da3e264-d602-4f25-a8cf-04b58c54c520 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:39:07.373658 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-5da3e264-d602-4f25-a8cf-04b58c54c520 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] [instance: 4e67b25e-7e65-4975-bafa-fceafcd53647] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:39:07.381636 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-adff9bbb-4333-4b04-bd14-99c636dead9b tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:39:07.384680 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-5da3e264-d602-4f25-a8cf-04b58c54c520 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:39:07.387660 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-5da3e264-d602-4f25-a8cf-04b58c54c520 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:39:07.388123 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-adff9bbb-4333-4b04-bd14-99c636dead9b tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:39:07.391276 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-5da3e264-d602-4f25-a8cf-04b58c54c520 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:39:07.391428 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-adff9bbb-4333-4b04-bd14-99c636dead9b tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "GET /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901" status: 200 len: 1808 microversion: 2.20 time: 0.487911 Jan 21 09:39:07.392595 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-5da3e264-d602-4f25-a8cf-04b58c54c520 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:39:07.404593 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 307/611] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jan 21 09:39:06 2022] GET /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901 => generated 1808 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 21 09:39:07.505580 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-5da3e264-d602-4f25-a8cf-04b58c54c520 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] 10.222.0.45 "GET /compute/v2.1/servers/4e67b25e-7e65-4975-bafa-fceafcd53647/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.132964 Jan 21 09:39:07.505774 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 305/612] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Jan 21 09:39:07 2022] GET /compute/v2.1/servers/4e67b25e-7e65-4975-bafa-fceafcd53647/os-volume_attachments => generated 197 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 09:39:08.412112 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-cc0fa325-0b3e-45a2-a6dc-96f4907499b1 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:39:08.412731 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-cc0fa325-0b3e-45a2-a6dc-96f4907499b1 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] [instance: 59ad64a5-af93-44ef-8031-fd2f2d18a901] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:39:08.420188 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-cc0fa325-0b3e-45a2-a6dc-96f4907499b1 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:39:08.420883 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-cc0fa325-0b3e-45a2-a6dc-96f4907499b1 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:39:08.421980 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-cc0fa325-0b3e-45a2-a6dc-96f4907499b1 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:39:08.422576 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-cc0fa325-0b3e-45a2-a6dc-96f4907499b1 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:39:08.529845 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-441b4e89-023a-4a69-8104-d7aceeb90a23 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:39:08.532545 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-441b4e89-023a-4a69-8104-d7aceeb90a23 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] [instance: 4e67b25e-7e65-4975-bafa-fceafcd53647] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:39:08.557415 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-441b4e89-023a-4a69-8104-d7aceeb90a23 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:39:08.558632 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-441b4e89-023a-4a69-8104-d7aceeb90a23 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:39:08.560343 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-441b4e89-023a-4a69-8104-d7aceeb90a23 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:39:08.564232 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-441b4e89-023a-4a69-8104-d7aceeb90a23 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:39:08.631173 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-441b4e89-023a-4a69-8104-d7aceeb90a23 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] 10.222.0.45 "GET /compute/v2.1/servers/4e67b25e-7e65-4975-bafa-fceafcd53647/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.120309 Jan 21 09:39:08.637658 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 306/613] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Jan 21 09:39:08 2022] GET /compute/v2.1/servers/4e67b25e-7e65-4975-bafa-fceafcd53647/os-volume_attachments => generated 197 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 09:39:08.655191 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-7bc96cc3-30b1-490d-bf0b-a32188ac297e tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:39:08.656377 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-7bc96cc3-30b1-490d-bf0b-a32188ac297e tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] [instance: ad91ae0f-410b-479b-82f5-c0e18d325a8b] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:39:08.679331 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-7bc96cc3-30b1-490d-bf0b-a32188ac297e tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:39:08.680426 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-7bc96cc3-30b1-490d-bf0b-a32188ac297e tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:39:08.681361 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-7bc96cc3-30b1-490d-bf0b-a32188ac297e tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:39:08.682000 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-7bc96cc3-30b1-490d-bf0b-a32188ac297e tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:39:08.714887 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-7bc96cc3-30b1-490d-bf0b-a32188ac297e tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] [instance: ad91ae0f-410b-479b-82f5-c0e18d325a8b] Going to try to terminate instance {{(pid=123386) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 21 09:39:08.809043 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-cc0fa325-0b3e-45a2-a6dc-96f4907499b1 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:39:08.827390 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-cc0fa325-0b3e-45a2-a6dc-96f4907499b1 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:39:08.833897 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-cc0fa325-0b3e-45a2-a6dc-96f4907499b1 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:39:08.837695 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-cc0fa325-0b3e-45a2-a6dc-96f4907499b1 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "GET /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901" status: 200 len: 1808 microversion: 2.20 time: 0.429702 Jan 21 09:39:08.841082 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 308/614] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jan 21 09:39:08 2022] GET /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901 => generated 1808 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 21 09:39:08.979020 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [req-41b0a1ff-f14a-4002-ab94-60ae03213dce req-dc599fd4-e6a3-4076-a105-9bde33c25de5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "750f8ae5-b267-4b76-bb13-170071722932", "tag": "d22f9cde-e9ce-4b37-9b2a-f673b65a0353"}]} {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:39:08.980692 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 21 09:39:08.980692 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: warnings.warn(msg) Jan 21 09:39:09.003621 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [req-41b0a1ff-f14a-4002-ab94-60ae03213dce req-dc599fd4-e6a3-4076-a105-9bde33c25de5 service nova] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:39:09.006193 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [req-41b0a1ff-f14a-4002-ab94-60ae03213dce req-dc599fd4-e6a3-4076-a105-9bde33c25de5 service nova] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:39:09.031115 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.compute.server_external_events [req-41b0a1ff-f14a-4002-ab94-60ae03213dce req-dc599fd4-e6a3-4076-a105-9bde33c25de5 service nova] Creating event network-changed:d22f9cde-e9ce-4b37-9b2a-f673b65a0353 for instance 750f8ae5-b267-4b76-bb13-170071722932 on hv-cinder-80403 Jan 21 09:39:09.037610 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [req-41b0a1ff-f14a-4002-ab94-60ae03213dce req-dc599fd4-e6a3-4076-a105-9bde33c25de5 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062384 Jan 21 09:39:09.048592 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 309/615] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Jan 21 09:39:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 09:39:09.104559 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-7bc96cc3-30b1-490d-bf0b-a32188ac297e tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] 10.222.0.45 "DELETE /compute/v2.1/servers/ad91ae0f-410b-479b-82f5-c0e18d325a8b" status: 204 len: 0 microversion: 2.1 time: 0.464892 Jan 21 09:39:09.105886 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 307/616] 10.222.0.45 () {58 vars in 1238 bytes} [Fri Jan 21 09:39:08 2022] DELETE /compute/v2.1/servers/ad91ae0f-410b-479b-82f5-c0e18d325a8b => generated 0 bytes in 467 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 21 09:39:09.115731 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-b1a69972-e4c7-47b3-896d-678a0e67985e tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:39:09.116427 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-b1a69972-e4c7-47b3-896d-678a0e67985e tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] [instance: ad91ae0f-410b-479b-82f5-c0e18d325a8b] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:39:09.130624 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-b1a69972-e4c7-47b3-896d-678a0e67985e tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:39:09.131079 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-b1a69972-e4c7-47b3-896d-678a0e67985e tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:39:09.135800 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-b1a69972-e4c7-47b3-896d-678a0e67985e tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:39:09.138501 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-b1a69972-e4c7-47b3-896d-678a0e67985e tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:39:09.509956 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-b1a69972-e4c7-47b3-896d-678a0e67985e tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7b2c14d9444d65ab7a874e749671bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3390729231b409e9a83376b428c1a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:39:09.532555 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-b1a69972-e4c7-47b3-896d-678a0e67985e tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] 10.222.0.45 "GET /compute/v2.1/servers/ad91ae0f-410b-479b-82f5-c0e18d325a8b" status: 200 len: 1514 microversion: 2.1 time: 0.422340 Jan 21 09:39:09.534826 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 310/617] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:39:09 2022] GET /compute/v2.1/servers/ad91ae0f-410b-479b-82f5-c0e18d325a8b => generated 1514 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:39:09.649887 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-2c0dcb34-0f82-4f7a-8661-311783f35339 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:39:09.651599 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-2c0dcb34-0f82-4f7a-8661-311783f35339 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] [instance: 4e67b25e-7e65-4975-bafa-fceafcd53647] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:39:09.671744 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-2c0dcb34-0f82-4f7a-8661-311783f35339 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:39:09.673540 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-2c0dcb34-0f82-4f7a-8661-311783f35339 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:39:09.674387 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-2c0dcb34-0f82-4f7a-8661-311783f35339 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:39:09.676829 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-2c0dcb34-0f82-4f7a-8661-311783f35339 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:39:09.769485 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-2c0dcb34-0f82-4f7a-8661-311783f35339 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] 10.222.0.45 "GET /compute/v2.1/servers/4e67b25e-7e65-4975-bafa-fceafcd53647/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.122626 Jan 21 09:39:09.783972 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 308/618] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Jan 21 09:39:09 2022] GET /compute/v2.1/servers/4e67b25e-7e65-4975-bafa-fceafcd53647/os-volume_attachments => generated 197 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 09:39:09.864511 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-4f59c525-dc44-4421-aaac-cbe7e41c53ba tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:39:09.866074 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-4f59c525-dc44-4421-aaac-cbe7e41c53ba tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] [instance: 59ad64a5-af93-44ef-8031-fd2f2d18a901] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:39:09.889393 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-4f59c525-dc44-4421-aaac-cbe7e41c53ba tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:39:09.890393 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-4f59c525-dc44-4421-aaac-cbe7e41c53ba tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:39:09.891490 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-4f59c525-dc44-4421-aaac-cbe7e41c53ba tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:39:09.895736 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-4f59c525-dc44-4421-aaac-cbe7e41c53ba tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:39:10.211070 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-4f59c525-dc44-4421-aaac-cbe7e41c53ba tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:39:10.223179 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-4f59c525-dc44-4421-aaac-cbe7e41c53ba tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:39:10.227415 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-4f59c525-dc44-4421-aaac-cbe7e41c53ba tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:39:10.237363 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-4f59c525-dc44-4421-aaac-cbe7e41c53ba tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "GET /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901" status: 200 len: 1808 microversion: 2.20 time: 0.371085 Jan 21 09:39:10.237363 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 311/619] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jan 21 09:39:09 2022] GET /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901 => generated 1808 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 21 09:39:10.551155 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-12ac39df-5c89-4ecd-ba97-edfcdd7ac557 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:39:10.551764 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-12ac39df-5c89-4ecd-ba97-edfcdd7ac557 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] [instance: ad91ae0f-410b-479b-82f5-c0e18d325a8b] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:39:10.582160 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-12ac39df-5c89-4ecd-ba97-edfcdd7ac557 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:39:10.583511 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-12ac39df-5c89-4ecd-ba97-edfcdd7ac557 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:39:10.584923 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-12ac39df-5c89-4ecd-ba97-edfcdd7ac557 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:39:10.588410 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-12ac39df-5c89-4ecd-ba97-edfcdd7ac557 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:39:10.769922 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-12ac39df-5c89-4ecd-ba97-edfcdd7ac557 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7b2c14d9444d65ab7a874e749671bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3390729231b409e9a83376b428c1a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:39:10.784772 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-d3160d13-4e11-4e67-b3c4-da3b03d78b7a tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:39:10.786170 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-d3160d13-4e11-4e67-b3c4-da3b03d78b7a tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] [instance: 4e67b25e-7e65-4975-bafa-fceafcd53647] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:39:10.798217 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-12ac39df-5c89-4ecd-ba97-edfcdd7ac557 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] 10.222.0.45 "GET /compute/v2.1/servers/ad91ae0f-410b-479b-82f5-c0e18d325a8b" status: 200 len: 1514 microversion: 2.1 time: 0.251125 Jan 21 09:39:10.803671 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-d3160d13-4e11-4e67-b3c4-da3b03d78b7a tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:39:10.804283 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-d3160d13-4e11-4e67-b3c4-da3b03d78b7a tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:39:10.805579 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 309/620] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:39:10 2022] GET /compute/v2.1/servers/ad91ae0f-410b-479b-82f5-c0e18d325a8b => generated 1514 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:39:10.805714 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-d3160d13-4e11-4e67-b3c4-da3b03d78b7a tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:39:10.806063 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-d3160d13-4e11-4e67-b3c4-da3b03d78b7a tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:39:10.852423 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-d3160d13-4e11-4e67-b3c4-da3b03d78b7a tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] 10.222.0.45 "GET /compute/v2.1/servers/4e67b25e-7e65-4975-bafa-fceafcd53647/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.072945 Jan 21 09:39:10.853007 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 312/621] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Jan 21 09:39:10 2022] GET /compute/v2.1/servers/4e67b25e-7e65-4975-bafa-fceafcd53647/os-volume_attachments => generated 197 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 21 09:39:11.255558 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-7b7715d1-5a1b-49a8-a65d-4a407967f6f2 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:39:11.257596 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-7b7715d1-5a1b-49a8-a65d-4a407967f6f2 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] [instance: 59ad64a5-af93-44ef-8031-fd2f2d18a901] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:39:11.275058 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-7b7715d1-5a1b-49a8-a65d-4a407967f6f2 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:39:11.281271 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-7b7715d1-5a1b-49a8-a65d-4a407967f6f2 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:39:11.284380 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-7b7715d1-5a1b-49a8-a65d-4a407967f6f2 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:39:11.285440 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-7b7715d1-5a1b-49a8-a65d-4a407967f6f2 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:39:11.515977 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-7b7715d1-5a1b-49a8-a65d-4a407967f6f2 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:39:11.534923 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-7b7715d1-5a1b-49a8-a65d-4a407967f6f2 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:39:11.541320 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-7b7715d1-5a1b-49a8-a65d-4a407967f6f2 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:39:11.544079 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-7b7715d1-5a1b-49a8-a65d-4a407967f6f2 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "GET /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901" status: 200 len: 1808 microversion: 2.20 time: 0.295472 Jan 21 09:39:11.549189 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 310/622] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jan 21 09:39:11 2022] GET /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901 => generated 1808 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 21 09:39:11.817379 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-5866e309-252b-4ab0-9681-d385a39a08ce tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:39:11.818845 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-5866e309-252b-4ab0-9681-d385a39a08ce tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] [instance: ad91ae0f-410b-479b-82f5-c0e18d325a8b] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:39:11.826711 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-5866e309-252b-4ab0-9681-d385a39a08ce tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:39:11.827361 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-5866e309-252b-4ab0-9681-d385a39a08ce tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:39:11.828204 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-5866e309-252b-4ab0-9681-d385a39a08ce tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:39:11.828637 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-5866e309-252b-4ab0-9681-d385a39a08ce tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:39:11.868917 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-e390fb39-28b8-4297-a212-b7496edb3abf tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:39:11.870057 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-e390fb39-28b8-4297-a212-b7496edb3abf tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] [instance: 4e67b25e-7e65-4975-bafa-fceafcd53647] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:39:11.878005 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-e390fb39-28b8-4297-a212-b7496edb3abf tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:39:11.878679 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-e390fb39-28b8-4297-a212-b7496edb3abf tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:39:11.879556 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-e390fb39-28b8-4297-a212-b7496edb3abf tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:39:11.880024 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-e390fb39-28b8-4297-a212-b7496edb3abf tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:39:11.929366 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-e390fb39-28b8-4297-a212-b7496edb3abf tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] 10.222.0.45 "GET /compute/v2.1/servers/4e67b25e-7e65-4975-bafa-fceafcd53647/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.068205 Jan 21 09:39:11.930849 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 311/623] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Jan 21 09:39:11 2022] GET /compute/v2.1/servers/4e67b25e-7e65-4975-bafa-fceafcd53647/os-volume_attachments => generated 197 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 09:39:12.158285 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-5866e309-252b-4ab0-9681-d385a39a08ce tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7b2c14d9444d65ab7a874e749671bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3390729231b409e9a83376b428c1a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:39:12.168036 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-5866e309-252b-4ab0-9681-d385a39a08ce tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] 10.222.0.45 "GET /compute/v2.1/servers/ad91ae0f-410b-479b-82f5-c0e18d325a8b" status: 200 len: 1514 microversion: 2.1 time: 0.355865 Jan 21 09:39:12.168660 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 313/624] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:39:11 2022] GET /compute/v2.1/servers/ad91ae0f-410b-479b-82f5-c0e18d325a8b => generated 1514 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:39:12.568257 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-1af03d57-55ff-4a65-88e6-6c2b18bf20af tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:39:12.569394 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-1af03d57-55ff-4a65-88e6-6c2b18bf20af tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] [instance: 59ad64a5-af93-44ef-8031-fd2f2d18a901] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:39:12.580690 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-1af03d57-55ff-4a65-88e6-6c2b18bf20af tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:39:12.581791 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-1af03d57-55ff-4a65-88e6-6c2b18bf20af tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:39:12.583915 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-1af03d57-55ff-4a65-88e6-6c2b18bf20af tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:39:12.585496 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-1af03d57-55ff-4a65-88e6-6c2b18bf20af tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:39:12.616530 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-1296c9ef-4b46-4ebd-a4cd-450bf469472b tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-71706229"}} {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:39:12.617597 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-1296c9ef-4b46-4ebd-a4cd-450bf469472b tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] [instance: 750f8ae5-b267-4b76-bb13-170071722932] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:39:12.628577 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-1296c9ef-4b46-4ebd-a4cd-450bf469472b tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:39:12.630396 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-1296c9ef-4b46-4ebd-a4cd-450bf469472b tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:39:12.631063 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-1296c9ef-4b46-4ebd-a4cd-450bf469472b tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:39:12.631898 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-1296c9ef-4b46-4ebd-a4cd-450bf469472b tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:39:12.979965 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.network.security_group_api [None req-1296c9ef-4b46-4ebd-a4cd-450bf469472b tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Adding security group 24c9a066-57df-44c0-a738-031af5f33ea2 to port d22f9cde-e9ce-4b37-9b2a-f673b65a0353 Jan 21 09:39:12.989930 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-1af03d57-55ff-4a65-88e6-6c2b18bf20af tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:39:13.006622 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-1af03d57-55ff-4a65-88e6-6c2b18bf20af tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:39:13.012358 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-1af03d57-55ff-4a65-88e6-6c2b18bf20af tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:39:13.017822 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-1af03d57-55ff-4a65-88e6-6c2b18bf20af tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "GET /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901" status: 200 len: 1808 microversion: 2.20 time: 0.455300 Jan 21 09:39:13.029706 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 312/625] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jan 21 09:39:12 2022] GET /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901 => generated 1808 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 21 09:39:13.038592 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [req-82f6491d-e913-4f4f-96e3-b9ea6c5f0c8b req-0cac074e-3beb-4809-b695-8bf217016a54 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad91ae0f-410b-479b-82f5-c0e18d325a8b", "name": "network-vif-deleted", "tag": "57b1afe5-3070-43a1-9f90-584240e66081"}]} {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:39:13.040836 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 21 09:39:13.040836 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: warnings.warn(msg) Jan 21 09:39:13.049444 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [req-82f6491d-e913-4f4f-96e3-b9ea6c5f0c8b req-0cac074e-3beb-4809-b695-8bf217016a54 service nova] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:39:13.051115 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [req-82f6491d-e913-4f4f-96e3-b9ea6c5f0c8b req-0cac074e-3beb-4809-b695-8bf217016a54 service nova] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:39:13.066830 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.compute.server_external_events [req-82f6491d-e913-4f4f-96e3-b9ea6c5f0c8b req-0cac074e-3beb-4809-b695-8bf217016a54 service nova] Creating event network-vif-deleted:57b1afe5-3070-43a1-9f90-584240e66081 for instance ad91ae0f-410b-479b-82f5-c0e18d325a8b on hv-cinder-80403 Jan 21 09:39:13.073556 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [req-82f6491d-e913-4f4f-96e3-b9ea6c5f0c8b req-0cac074e-3beb-4809-b695-8bf217016a54 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039287 Jan 21 09:39:13.075701 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 313/626] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Jan 21 09:39:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 09:39:13.083162 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-7444279e-d933-4329-9608-cf9395067ccc tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:39:13.084500 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-7444279e-d933-4329-9608-cf9395067ccc tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] [instance: 4e67b25e-7e65-4975-bafa-fceafcd53647] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:39:13.093777 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-7444279e-d933-4329-9608-cf9395067ccc tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:39:13.094607 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-7444279e-d933-4329-9608-cf9395067ccc tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:39:13.095510 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-7444279e-d933-4329-9608-cf9395067ccc tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:39:13.096051 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-7444279e-d933-4329-9608-cf9395067ccc tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:39:13.138721 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-7444279e-d933-4329-9608-cf9395067ccc tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] 10.222.0.45 "GET /compute/v2.1/servers/4e67b25e-7e65-4975-bafa-fceafcd53647/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.061162 Jan 21 09:39:13.139940 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 314/627] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Jan 21 09:39:13 2022] GET /compute/v2.1/servers/4e67b25e-7e65-4975-bafa-fceafcd53647/os-volume_attachments => generated 25 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 21 09:39:13.191767 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-b6b31ef0-4d70-46cd-9d1d-ff0997db99e4 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:39:13.192394 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-b6b31ef0-4d70-46cd-9d1d-ff0997db99e4 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] [instance: ad91ae0f-410b-479b-82f5-c0e18d325a8b] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:39:13.203465 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-b6b31ef0-4d70-46cd-9d1d-ff0997db99e4 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:39:13.203925 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-b6b31ef0-4d70-46cd-9d1d-ff0997db99e4 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:39:13.208979 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-b6b31ef0-4d70-46cd-9d1d-ff0997db99e4 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:39:13.208979 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-b6b31ef0-4d70-46cd-9d1d-ff0997db99e4 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:39:13.549870 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-b6b31ef0-4d70-46cd-9d1d-ff0997db99e4 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7b2c14d9444d65ab7a874e749671bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3390729231b409e9a83376b428c1a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:39:13.556477 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-b6b31ef0-4d70-46cd-9d1d-ff0997db99e4 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] 10.222.0.45 "GET /compute/v2.1/servers/ad91ae0f-410b-479b-82f5-c0e18d325a8b" status: 200 len: 1472 microversion: 2.1 time: 0.369279 Jan 21 09:39:13.557066 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 315/628] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:39:13 2022] GET /compute/v2.1/servers/ad91ae0f-410b-479b-82f5-c0e18d325a8b => generated 1472 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:39:13.832360 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-1296c9ef-4b46-4ebd-a4cd-450bf469472b tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] 10.222.0.45 "POST /compute/v2.1/servers/750f8ae5-b267-4b76-bb13-170071722932/action" status: 202 len: 0 microversion: 2.1 time: 1.222762 Jan 21 09:39:13.833602 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 314/629] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Jan 21 09:39:12 2022] POST /compute/v2.1/servers/750f8ae5-b267-4b76-bb13-170071722932/action => generated 0 bytes in 1225 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jan 21 09:39:13.841462 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-97f2d3a5-3758-4071-b81e-f02de38550c1 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:39:13.842080 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-97f2d3a5-3758-4071-b81e-f02de38550c1 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] [instance: 750f8ae5-b267-4b76-bb13-170071722932] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:39:13.849786 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-97f2d3a5-3758-4071-b81e-f02de38550c1 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:39:13.850489 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-97f2d3a5-3758-4071-b81e-f02de38550c1 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:39:13.851289 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-97f2d3a5-3758-4071-b81e-f02de38550c1 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:39:13.851732 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-97f2d3a5-3758-4071-b81e-f02de38550c1 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:39:14.007569 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-97f2d3a5-3758-4071-b81e-f02de38550c1 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a8838f167743678110ca0a9d5a2484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10ed49573f464cc18794b94fd1c115ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:39:14.015346 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-97f2d3a5-3758-4071-b81e-f02de38550c1 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] 10.222.0.45 "GET /compute/v2.1/servers/750f8ae5-b267-4b76-bb13-170071722932" status: 200 len: 1757 microversion: 2.1 time: 0.177549 Jan 21 09:39:14.015911 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 316/630] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:39:13 2022] GET /compute/v2.1/servers/750f8ae5-b267-4b76-bb13-170071722932 => generated 1757 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:39:14.039623 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-6327334e-66ac-4218-9974-e3fcc63366da tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:39:14.040225 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-6327334e-66ac-4218-9974-e3fcc63366da tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] [instance: 59ad64a5-af93-44ef-8031-fd2f2d18a901] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:39:14.046768 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-6327334e-66ac-4218-9974-e3fcc63366da tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:39:14.047206 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-6327334e-66ac-4218-9974-e3fcc63366da tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:39:14.048019 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-6327334e-66ac-4218-9974-e3fcc63366da tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:39:14.048447 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-6327334e-66ac-4218-9974-e3fcc63366da tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:39:14.191214 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-6327334e-66ac-4218-9974-e3fcc63366da tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:39:14.200118 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-6327334e-66ac-4218-9974-e3fcc63366da tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:39:14.201641 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-6327334e-66ac-4218-9974-e3fcc63366da tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:39:14.202809 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-6327334e-66ac-4218-9974-e3fcc63366da tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "GET /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901" status: 200 len: 1808 microversion: 2.20 time: 0.166911 Jan 21 09:39:14.203380 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 315/631] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jan 21 09:39:14 2022] GET /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901 => generated 1808 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 21 09:39:14.572994 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-d8d51682-207c-45ee-85a4-c89318a45a0c tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:39:14.573907 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-d8d51682-207c-45ee-85a4-c89318a45a0c tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] [instance: ad91ae0f-410b-479b-82f5-c0e18d325a8b] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:39:14.580514 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-d8d51682-207c-45ee-85a4-c89318a45a0c tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:39:14.581127 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-d8d51682-207c-45ee-85a4-c89318a45a0c tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:39:14.583797 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-d8d51682-207c-45ee-85a4-c89318a45a0c tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:39:14.583797 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-d8d51682-207c-45ee-85a4-c89318a45a0c tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:39:14.648215 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-d8d51682-207c-45ee-85a4-c89318a45a0c tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7b2c14d9444d65ab7a874e749671bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3390729231b409e9a83376b428c1a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:39:14.655820 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-d8d51682-207c-45ee-85a4-c89318a45a0c tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] 10.222.0.45 "GET /compute/v2.1/servers/ad91ae0f-410b-479b-82f5-c0e18d325a8b" status: 200 len: 1472 microversion: 2.1 time: 0.086466 Jan 21 09:39:14.656399 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 317/632] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:39:14 2022] GET /compute/v2.1/servers/ad91ae0f-410b-479b-82f5-c0e18d325a8b => generated 1472 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:39:15.091396 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [req-9b488931-8804-4a8f-a456-46d7aa39bda2 req-33a1b333-38eb-4d3b-9aa4-d82f428bb6a1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "750f8ae5-b267-4b76-bb13-170071722932", "tag": "d22f9cde-e9ce-4b37-9b2a-f673b65a0353"}]} {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:39:15.092957 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 21 09:39:15.092957 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: warnings.warn(msg) Jan 21 09:39:15.101242 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [req-9b488931-8804-4a8f-a456-46d7aa39bda2 req-33a1b333-38eb-4d3b-9aa4-d82f428bb6a1 service nova] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:39:15.101689 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [req-9b488931-8804-4a8f-a456-46d7aa39bda2 req-33a1b333-38eb-4d3b-9aa4-d82f428bb6a1 service nova] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:39:15.114968 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.compute.server_external_events [req-9b488931-8804-4a8f-a456-46d7aa39bda2 req-33a1b333-38eb-4d3b-9aa4-d82f428bb6a1 service nova] Creating event network-changed:d22f9cde-e9ce-4b37-9b2a-f673b65a0353 for instance 750f8ae5-b267-4b76-bb13-170071722932 on hv-cinder-80403 Jan 21 09:39:15.120370 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [req-9b488931-8804-4a8f-a456-46d7aa39bda2 req-33a1b333-38eb-4d3b-9aa4-d82f428bb6a1 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032600 Jan 21 09:39:15.120976 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 316/633] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Jan 21 09:39:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 09:39:15.222963 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-90fff743-e505-437f-8a26-4c6a355cb522 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:39:15.223575 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-90fff743-e505-437f-8a26-4c6a355cb522 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] [instance: 59ad64a5-af93-44ef-8031-fd2f2d18a901] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:39:15.229942 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-90fff743-e505-437f-8a26-4c6a355cb522 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:39:15.241352 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-90fff743-e505-437f-8a26-4c6a355cb522 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:39:15.241352 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-90fff743-e505-437f-8a26-4c6a355cb522 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:39:15.241352 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-90fff743-e505-437f-8a26-4c6a355cb522 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:39:15.373022 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-90fff743-e505-437f-8a26-4c6a355cb522 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:39:15.383019 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-90fff743-e505-437f-8a26-4c6a355cb522 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:39:15.384528 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-90fff743-e505-437f-8a26-4c6a355cb522 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:39:15.385726 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-90fff743-e505-437f-8a26-4c6a355cb522 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "GET /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901" status: 200 len: 1808 microversion: 2.20 time: 0.166668 Jan 21 09:39:15.386295 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 318/634] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jan 21 09:39:15 2022] GET /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901 => generated 1808 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 21 09:39:15.674357 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-03fd2aed-4a6b-403e-94e5-936d6b9a602f tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:39:15.675384 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-03fd2aed-4a6b-403e-94e5-936d6b9a602f tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] [instance: ad91ae0f-410b-479b-82f5-c0e18d325a8b] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:39:15.682443 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-03fd2aed-4a6b-403e-94e5-936d6b9a602f tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:39:15.682991 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-03fd2aed-4a6b-403e-94e5-936d6b9a602f tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:39:15.683896 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-03fd2aed-4a6b-403e-94e5-936d6b9a602f tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:39:15.684564 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-03fd2aed-4a6b-403e-94e5-936d6b9a602f tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:39:15.751283 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-03fd2aed-4a6b-403e-94e5-936d6b9a602f tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7b2c14d9444d65ab7a874e749671bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3390729231b409e9a83376b428c1a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:39:15.754847 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-03fd2aed-4a6b-403e-94e5-936d6b9a602f tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] 10.222.0.45 "GET /compute/v2.1/servers/ad91ae0f-410b-479b-82f5-c0e18d325a8b" status: 200 len: 1303 microversion: 2.1 time: 0.085240 Jan 21 09:39:15.755419 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 317/635] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:39:15 2022] GET /compute/v2.1/servers/ad91ae0f-410b-479b-82f5-c0e18d325a8b => generated 1303 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:39:16.404369 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-d612d5c2-be07-4dc5-9ed3-0cf49cfd314c tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:39:16.405010 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-d612d5c2-be07-4dc5-9ed3-0cf49cfd314c tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] [instance: 59ad64a5-af93-44ef-8031-fd2f2d18a901] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:39:16.412256 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-d612d5c2-be07-4dc5-9ed3-0cf49cfd314c tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:39:16.412710 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-d612d5c2-be07-4dc5-9ed3-0cf49cfd314c tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:39:16.413595 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-d612d5c2-be07-4dc5-9ed3-0cf49cfd314c tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:39:16.414030 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-d612d5c2-be07-4dc5-9ed3-0cf49cfd314c tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:39:16.561369 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-d612d5c2-be07-4dc5-9ed3-0cf49cfd314c tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:39:16.570359 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-d612d5c2-be07-4dc5-9ed3-0cf49cfd314c tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:39:16.571862 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-d612d5c2-be07-4dc5-9ed3-0cf49cfd314c tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:39:16.573014 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-d612d5c2-be07-4dc5-9ed3-0cf49cfd314c tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "GET /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901" status: 200 len: 1808 microversion: 2.20 time: 0.172431 Jan 21 09:39:16.573646 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 319/636] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jan 21 09:39:16 2022] GET /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901 => generated 1808 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 21 09:39:16.772013 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-ab624fb7-ee9e-4400-82c4-a7d0806fdf0d tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:39:16.772621 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-ab624fb7-ee9e-4400-82c4-a7d0806fdf0d tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] [instance: ad91ae0f-410b-479b-82f5-c0e18d325a8b] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:39:16.779200 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-ab624fb7-ee9e-4400-82c4-a7d0806fdf0d tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:39:16.779657 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-ab624fb7-ee9e-4400-82c4-a7d0806fdf0d tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:39:16.780436 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-ab624fb7-ee9e-4400-82c4-a7d0806fdf0d tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:39:16.780869 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-ab624fb7-ee9e-4400-82c4-a7d0806fdf0d tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:39:16.816724 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-ab624fb7-ee9e-4400-82c4-a7d0806fdf0d tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:39:16.817312 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-ab624fb7-ee9e-4400-82c4-a7d0806fdf0d tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:39:16.817767 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.objects.instance [None req-ab624fb7-ee9e-4400-82c4-a7d0806fdf0d tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lazy-loading 'fault' on Instance uuid ad91ae0f-410b-479b-82f5-c0e18d325a8b {{(pid=123387) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 21 09:39:16.859648 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-ab624fb7-ee9e-4400-82c4-a7d0806fdf0d tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7b2c14d9444d65ab7a874e749671bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3390729231b409e9a83376b428c1a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:39:16.868526 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-ab624fb7-ee9e-4400-82c4-a7d0806fdf0d tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] 10.222.0.45 "GET /compute/v2.1/servers/ad91ae0f-410b-479b-82f5-c0e18d325a8b" status: 200 len: 1308 microversion: 2.1 time: 0.100911 Jan 21 09:39:16.869109 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 318/637] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:39:16 2022] GET /compute/v2.1/servers/ad91ae0f-410b-479b-82f5-c0e18d325a8b => generated 1308 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:39:17.506762 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-a0c160e6-5577-417f-8b1e-6891fd0d3da5 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1500495115", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-772796190", "security_groups": [{"name": "tempest-secgroup-smoke-159313003"}], "block_device_mapping_v2": [{"uuid": "dcc10ad4-b0a3-4923-8876-379fa078743e", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "858c4f17-92ac-4cda-9750-b98e2d3705f8"}]}} {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:39:17.601619 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-f2d6abc4-1a69-423e-85bd-0dac625dbb30 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:39:17.603385 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-f2d6abc4-1a69-423e-85bd-0dac625dbb30 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] [instance: 59ad64a5-af93-44ef-8031-fd2f2d18a901] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:39:17.617090 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-f2d6abc4-1a69-423e-85bd-0dac625dbb30 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:39:17.617779 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-f2d6abc4-1a69-423e-85bd-0dac625dbb30 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:39:17.618781 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-f2d6abc4-1a69-423e-85bd-0dac625dbb30 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:39:17.619405 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-f2d6abc4-1a69-423e-85bd-0dac625dbb30 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:39:17.634500 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.network.neutron [None req-a0c160e6-5577-417f-8b1e-6891fd0d3da5 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] validate_networks() for [('858c4f17-92ac-4cda-9750-b98e2d3705f8', None, None, None, None, None)] {{(pid=123386) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 21 09:39:17.913469 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-f2d6abc4-1a69-423e-85bd-0dac625dbb30 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:39:17.922511 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-f2d6abc4-1a69-423e-85bd-0dac625dbb30 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:39:17.924785 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-f2d6abc4-1a69-423e-85bd-0dac625dbb30 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:39:17.933379 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-f2d6abc4-1a69-423e-85bd-0dac625dbb30 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "GET /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901" status: 200 len: 1808 microversion: 2.20 time: 0.336843 Jan 21 09:39:17.933379 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 319/638] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jan 21 09:39:17 2022] GET /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901 => generated 1808 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 21 09:39:17.933379 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-9f5dbfc2-c89d-4b31-a7cf-35f0fac89ebe tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:39:17.933379 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-9f5dbfc2-c89d-4b31-a7cf-35f0fac89ebe tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] [instance: ad91ae0f-410b-479b-82f5-c0e18d325a8b] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:39:17.938103 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-9f5dbfc2-c89d-4b31-a7cf-35f0fac89ebe tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:39:17.938561 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-9f5dbfc2-c89d-4b31-a7cf-35f0fac89ebe tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:39:17.939987 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-9f5dbfc2-c89d-4b31-a7cf-35f0fac89ebe tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:39:17.940611 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-9f5dbfc2-c89d-4b31-a7cf-35f0fac89ebe tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:39:17.954378 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.wsgi [None req-9f5dbfc2-c89d-4b31-a7cf-35f0fac89ebe tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] HTTP exception thrown: Instance ad91ae0f-410b-479b-82f5-c0e18d325a8b could not be found. Jan 21 09:39:17.955829 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-9f5dbfc2-c89d-4b31-a7cf-35f0fac89ebe tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Returning 404 to user: Instance ad91ae0f-410b-479b-82f5-c0e18d325a8b could not be found. {{(pid=123387) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 21 09:39:17.956756 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-9f5dbfc2-c89d-4b31-a7cf-35f0fac89ebe tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] 10.222.0.45 "GET /compute/v2.1/servers/ad91ae0f-410b-479b-82f5-c0e18d325a8b" status: 404 len: 111 microversion: 2.1 time: 0.028702 Jan 21 09:39:17.957344 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 320/639] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:39:17 2022] GET /compute/v2.1/servers/ad91ae0f-410b-479b-82f5-c0e18d325a8b => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 21 09:39:17.968844 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-139c86dd-cc00-45dd-a746-efbb145f8e82 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:39:17.969369 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-139c86dd-cc00-45dd-a746-efbb145f8e82 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] [instance: bc1c3d0f-0474-4bad-b8a1-7c7d169b6ad0] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:39:17.976331 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-139c86dd-cc00-45dd-a746-efbb145f8e82 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:39:17.976331 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-139c86dd-cc00-45dd-a746-efbb145f8e82 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:39:17.977118 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-139c86dd-cc00-45dd-a746-efbb145f8e82 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:39:17.977439 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-139c86dd-cc00-45dd-a746-efbb145f8e82 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:39:18.013653 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-139c86dd-cc00-45dd-a746-efbb145f8e82 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] [instance: bc1c3d0f-0474-4bad-b8a1-7c7d169b6ad0] Going to try to terminate instance {{(pid=123387) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 21 09:39:18.168396 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.virt.hardware [None req-a0c160e6-5577-417f-8b1e-6891fd0d3da5 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Flavor limits 0:0:0 {{(pid=123386) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 21 09:39:18.168813 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.virt.hardware [None req-a0c160e6-5577-417f-8b1e-6891fd0d3da5 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Image limits 0:0:0 {{(pid=123386) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 21 09:39:18.169359 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.virt.hardware [None req-a0c160e6-5577-417f-8b1e-6891fd0d3da5 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Flavor pref 0:0:0 {{(pid=123386) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 21 09:39:18.169761 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.virt.hardware [None req-a0c160e6-5577-417f-8b1e-6891fd0d3da5 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Image pref 0:0:0 {{(pid=123386) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 21 09:39:18.170165 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.virt.hardware [None req-a0c160e6-5577-417f-8b1e-6891fd0d3da5 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123386) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 21 09:39:18.179887 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-a0c160e6-5577-417f-8b1e-6891fd0d3da5 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:39:18.184416 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-a0c160e6-5577-417f-8b1e-6891fd0d3da5 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:39:18.184416 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-a0c160e6-5577-417f-8b1e-6891fd0d3da5 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:39:18.184416 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-a0c160e6-5577-417f-8b1e-6891fd0d3da5 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:39:18.198295 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.quota [None req-a0c160e6-5577-417f-8b1e-6891fd0d3da5 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Getting quotas for project 515ded26ca114fbf9c6e920362aec64c. Resources: {'cores', 'instances', 'ram'} {{(pid=123386) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 21 09:39:18.202373 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.quota [None req-a0c160e6-5577-417f-8b1e-6891fd0d3da5 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Getting quotas for user 3d53a7fa2cb5498aa916817b82dba77e and project 515ded26ca114fbf9c6e920362aec64c. Resources: {'cores', 'instances', 'ram'} {{(pid=123386) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 21 09:39:18.258150 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-a0c160e6-5577-417f-8b1e-6891fd0d3da5 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Going to run 1 instances... {{(pid=123386) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 21 09:39:18.260319 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-a0c160e6-5577-417f-8b1e-6891fd0d3da5 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] [instance: 2733931f-f68e-4f48-85d2-5060a8f55eec] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='dcc10ad4-b0a3-4923-8876-379fa078743e',volume_size=None,volume_type=None)] {{(pid=123386) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 21 09:39:18.474473 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-139c86dd-cc00-45dd-a746-efbb145f8e82 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] 10.222.0.45 "DELETE /compute/v2.1/servers/bc1c3d0f-0474-4bad-b8a1-7c7d169b6ad0" status: 204 len: 0 microversion: 2.1 time: 0.510431 Jan 21 09:39:18.476636 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 321/640] 10.222.0.45 () {58 vars in 1238 bytes} [Fri Jan 21 09:39:17 2022] DELETE /compute/v2.1/servers/bc1c3d0f-0474-4bad-b8a1-7c7d169b6ad0 => generated 0 bytes in 513 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 21 09:39:18.489234 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-14ab04d8-766b-4df3-87da-84d399600614 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:39:18.490217 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-14ab04d8-766b-4df3-87da-84d399600614 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] [instance: bc1c3d0f-0474-4bad-b8a1-7c7d169b6ad0] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:39:18.497752 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-14ab04d8-766b-4df3-87da-84d399600614 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:39:18.498411 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-14ab04d8-766b-4df3-87da-84d399600614 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:39:18.499406 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-14ab04d8-766b-4df3-87da-84d399600614 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:39:18.499999 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-14ab04d8-766b-4df3-87da-84d399600614 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:39:18.647401 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-14ab04d8-766b-4df3-87da-84d399600614 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7b2c14d9444d65ab7a874e749671bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3390729231b409e9a83376b428c1a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:39:18.655141 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-14ab04d8-766b-4df3-87da-84d399600614 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] 10.222.0.45 "GET /compute/v2.1/servers/bc1c3d0f-0474-4bad-b8a1-7c7d169b6ad0" status: 200 len: 1514 microversion: 2.1 time: 0.172623 Jan 21 09:39:18.655724 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 322/641] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:39:18 2022] GET /compute/v2.1/servers/bc1c3d0f-0474-4bad-b8a1-7c7d169b6ad0 => generated 1514 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 09:39:18.728116 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-a0c160e6-5577-417f-8b1e-6891fd0d3da5 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.221960 Jan 21 09:39:18.728116 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 320/642] 10.222.0.45 () {60 vars in 1146 bytes} [Fri Jan 21 09:39:17 2022] POST /compute/v2.1/servers => generated 405 bytes in 1224 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 21 09:39:18.739013 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-73b59e89-9fc8-4385-b615-c0e2a69c89a8 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:39:18.739635 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-73b59e89-9fc8-4385-b615-c0e2a69c89a8 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] [instance: 2733931f-f68e-4f48-85d2-5060a8f55eec] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:39:18.798354 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-73b59e89-9fc8-4385-b615-c0e2a69c89a8 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d53a7fa2cb5498aa916817b82dba77e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515ded26ca114fbf9c6e920362aec64c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:39:18.806333 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-73b59e89-9fc8-4385-b615-c0e2a69c89a8 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] 10.222.0.45 "GET /compute/v2.1/servers/2733931f-f68e-4f48-85d2-5060a8f55eec" status: 200 len: 1094 microversion: 2.1 time: 0.073011 Jan 21 09:39:18.806911 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 323/643] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:39:18 2022] GET /compute/v2.1/servers/2733931f-f68e-4f48-85d2-5060a8f55eec => generated 1094 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 09:39:18.951978 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-9cd5a2fe-aa5b-414c-ace1-714c770e8839 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:39:18.952598 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-9cd5a2fe-aa5b-414c-ace1-714c770e8839 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] [instance: 59ad64a5-af93-44ef-8031-fd2f2d18a901] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:39:18.959523 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-9cd5a2fe-aa5b-414c-ace1-714c770e8839 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:39:18.959968 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-9cd5a2fe-aa5b-414c-ace1-714c770e8839 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:39:18.960756 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-9cd5a2fe-aa5b-414c-ace1-714c770e8839 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:39:18.961225 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-9cd5a2fe-aa5b-414c-ace1-714c770e8839 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:39:19.113583 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-9cd5a2fe-aa5b-414c-ace1-714c770e8839 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:39:19.122605 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-9cd5a2fe-aa5b-414c-ace1-714c770e8839 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:39:19.124112 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-9cd5a2fe-aa5b-414c-ace1-714c770e8839 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:39:19.125317 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-9cd5a2fe-aa5b-414c-ace1-714c770e8839 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "GET /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901" status: 200 len: 1808 microversion: 2.20 time: 0.177312 Jan 21 09:39:19.125886 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 321/644] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jan 21 09:39:18 2022] GET /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901 => generated 1808 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 21 09:39:19.671862 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-d2621a90-0df9-421f-bf3a-e3642dc1976a tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:39:19.672470 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-d2621a90-0df9-421f-bf3a-e3642dc1976a tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] [instance: bc1c3d0f-0474-4bad-b8a1-7c7d169b6ad0] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:39:19.678663 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-d2621a90-0df9-421f-bf3a-e3642dc1976a tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:39:19.678993 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-d2621a90-0df9-421f-bf3a-e3642dc1976a tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:39:19.679834 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-d2621a90-0df9-421f-bf3a-e3642dc1976a tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:39:19.680272 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-d2621a90-0df9-421f-bf3a-e3642dc1976a tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:39:19.825496 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-d2621a90-0df9-421f-bf3a-e3642dc1976a tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7b2c14d9444d65ab7a874e749671bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3390729231b409e9a83376b428c1a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:39:19.831747 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-ec7b9ee7-c847-42e5-9f4b-de3c79db10d6 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:39:19.832799 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-ec7b9ee7-c847-42e5-9f4b-de3c79db10d6 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] [instance: 2733931f-f68e-4f48-85d2-5060a8f55eec] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:39:19.834670 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-d2621a90-0df9-421f-bf3a-e3642dc1976a tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] 10.222.0.45 "GET /compute/v2.1/servers/bc1c3d0f-0474-4bad-b8a1-7c7d169b6ad0" status: 200 len: 1514 microversion: 2.1 time: 0.166401 Jan 21 09:39:19.835291 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 324/645] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:39:19 2022] GET /compute/v2.1/servers/bc1c3d0f-0474-4bad-b8a1-7c7d169b6ad0 => generated 1514 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:39:19.841445 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-ec7b9ee7-c847-42e5-9f4b-de3c79db10d6 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:39:19.841903 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-ec7b9ee7-c847-42e5-9f4b-de3c79db10d6 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:39:19.842924 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-ec7b9ee7-c847-42e5-9f4b-de3c79db10d6 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:39:19.843506 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-ec7b9ee7-c847-42e5-9f4b-de3c79db10d6 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:39:19.906079 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-ec7b9ee7-c847-42e5-9f4b-de3c79db10d6 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d53a7fa2cb5498aa916817b82dba77e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515ded26ca114fbf9c6e920362aec64c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:39:19.915244 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-ec7b9ee7-c847-42e5-9f4b-de3c79db10d6 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] 10.222.0.45 "GET /compute/v2.1/servers/2733931f-f68e-4f48-85d2-5060a8f55eec" status: 200 len: 1144 microversion: 2.1 time: 0.095145 Jan 21 09:39:19.915825 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 322/646] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:39:19 2022] GET /compute/v2.1/servers/2733931f-f68e-4f48-85d2-5060a8f55eec => generated 1144 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 09:39:20.145643 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-03f745c5-cdfb-499f-94da-443f86ad410b tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:39:20.146211 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-03f745c5-cdfb-499f-94da-443f86ad410b tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] [instance: 59ad64a5-af93-44ef-8031-fd2f2d18a901] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:39:20.151974 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-03f745c5-cdfb-499f-94da-443f86ad410b tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:39:20.152416 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-03f745c5-cdfb-499f-94da-443f86ad410b tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:39:20.153226 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-03f745c5-cdfb-499f-94da-443f86ad410b tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:39:20.153657 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-03f745c5-cdfb-499f-94da-443f86ad410b tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:39:20.304887 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-03f745c5-cdfb-499f-94da-443f86ad410b tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:39:20.313417 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-03f745c5-cdfb-499f-94da-443f86ad410b tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:39:20.315567 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-03f745c5-cdfb-499f-94da-443f86ad410b tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:39:20.316802 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-03f745c5-cdfb-499f-94da-443f86ad410b tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "GET /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901" status: 200 len: 1808 microversion: 2.20 time: 0.174992 Jan 21 09:39:20.317399 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 325/647] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jan 21 09:39:20 2022] GET /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901 => generated 1808 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 21 09:39:20.855948 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-2a4acaba-503a-4f3d-b01c-141ca3d5df11 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:39:20.856585 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-2a4acaba-503a-4f3d-b01c-141ca3d5df11 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] [instance: bc1c3d0f-0474-4bad-b8a1-7c7d169b6ad0] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:39:20.863567 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-2a4acaba-503a-4f3d-b01c-141ca3d5df11 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:39:20.864010 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-2a4acaba-503a-4f3d-b01c-141ca3d5df11 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:39:20.864796 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-2a4acaba-503a-4f3d-b01c-141ca3d5df11 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:39:20.865256 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-2a4acaba-503a-4f3d-b01c-141ca3d5df11 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:39:20.932577 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-b5400693-28d6-4c34-9454-b5f666a4e3a9 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:39:20.933201 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-b5400693-28d6-4c34-9454-b5f666a4e3a9 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] [instance: 2733931f-f68e-4f48-85d2-5060a8f55eec] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:39:20.940743 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-b5400693-28d6-4c34-9454-b5f666a4e3a9 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:39:20.941079 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-b5400693-28d6-4c34-9454-b5f666a4e3a9 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:39:20.941889 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-b5400693-28d6-4c34-9454-b5f666a4e3a9 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:39:20.942320 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-b5400693-28d6-4c34-9454-b5f666a4e3a9 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:39:21.009329 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-b5400693-28d6-4c34-9454-b5f666a4e3a9 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d53a7fa2cb5498aa916817b82dba77e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515ded26ca114fbf9c6e920362aec64c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:39:21.016424 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-b5400693-28d6-4c34-9454-b5f666a4e3a9 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] 10.222.0.45 "GET /compute/v2.1/servers/2733931f-f68e-4f48-85d2-5060a8f55eec" status: 200 len: 1144 microversion: 2.1 time: 0.087412 Jan 21 09:39:21.017343 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 326/648] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:39:20 2022] GET /compute/v2.1/servers/2733931f-f68e-4f48-85d2-5060a8f55eec => generated 1144 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 09:39:21.020804 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-2a4acaba-503a-4f3d-b01c-141ca3d5df11 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7b2c14d9444d65ab7a874e749671bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3390729231b409e9a83376b428c1a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:39:21.028353 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-2a4acaba-503a-4f3d-b01c-141ca3d5df11 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] 10.222.0.45 "GET /compute/v2.1/servers/bc1c3d0f-0474-4bad-b8a1-7c7d169b6ad0" status: 200 len: 1514 microversion: 2.1 time: 0.176089 Jan 21 09:39:21.028914 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 323/649] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:39:20 2022] GET /compute/v2.1/servers/bc1c3d0f-0474-4bad-b8a1-7c7d169b6ad0 => generated 1514 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:39:21.334338 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-8c6e9540-7619-4d4b-af39-e435bfc483eb tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:39:21.334940 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-8c6e9540-7619-4d4b-af39-e435bfc483eb tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] [instance: 59ad64a5-af93-44ef-8031-fd2f2d18a901] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:39:21.341179 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-8c6e9540-7619-4d4b-af39-e435bfc483eb tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:39:21.341632 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-8c6e9540-7619-4d4b-af39-e435bfc483eb tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:39:21.342439 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-8c6e9540-7619-4d4b-af39-e435bfc483eb tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:39:21.342902 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-8c6e9540-7619-4d4b-af39-e435bfc483eb tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:39:21.480604 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-8c6e9540-7619-4d4b-af39-e435bfc483eb tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:39:21.490779 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-8c6e9540-7619-4d4b-af39-e435bfc483eb tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:39:21.492276 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-8c6e9540-7619-4d4b-af39-e435bfc483eb tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:39:21.493445 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-8c6e9540-7619-4d4b-af39-e435bfc483eb tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "GET /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901" status: 200 len: 1808 microversion: 2.20 time: 0.162950 Jan 21 09:39:21.494055 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 327/650] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jan 21 09:39:21 2022] GET /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901 => generated 1808 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 21 09:39:22.033318 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-58b5aa23-ce6b-4031-832b-3b6964a95875 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:39:22.034401 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-58b5aa23-ce6b-4031-832b-3b6964a95875 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] [instance: 2733931f-f68e-4f48-85d2-5060a8f55eec] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:39:22.042058 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-58b5aa23-ce6b-4031-832b-3b6964a95875 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:39:22.042778 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-58b5aa23-ce6b-4031-832b-3b6964a95875 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:39:22.043578 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-58b5aa23-ce6b-4031-832b-3b6964a95875 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:39:22.044018 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-58b5aa23-ce6b-4031-832b-3b6964a95875 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:39:22.045319 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-b632394e-efe9-4f96-8a03-9b9d3af64a3a tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:39:22.046159 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-b632394e-efe9-4f96-8a03-9b9d3af64a3a tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] [instance: bc1c3d0f-0474-4bad-b8a1-7c7d169b6ad0] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:39:22.058502 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-b632394e-efe9-4f96-8a03-9b9d3af64a3a tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:39:22.058958 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-b632394e-efe9-4f96-8a03-9b9d3af64a3a tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:39:22.059753 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-b632394e-efe9-4f96-8a03-9b9d3af64a3a tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:39:22.060186 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-b632394e-efe9-4f96-8a03-9b9d3af64a3a tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:39:22.115251 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-58b5aa23-ce6b-4031-832b-3b6964a95875 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d53a7fa2cb5498aa916817b82dba77e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515ded26ca114fbf9c6e920362aec64c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:39:22.126431 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-58b5aa23-ce6b-4031-832b-3b6964a95875 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] 10.222.0.45 "GET /compute/v2.1/servers/2733931f-f68e-4f48-85d2-5060a8f55eec" status: 200 len: 1192 microversion: 2.1 time: 0.096775 Jan 21 09:39:22.128011 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 324/651] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:39:22 2022] GET /compute/v2.1/servers/2733931f-f68e-4f48-85d2-5060a8f55eec => generated 1192 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:39:22.225829 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-b632394e-efe9-4f96-8a03-9b9d3af64a3a tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7b2c14d9444d65ab7a874e749671bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3390729231b409e9a83376b428c1a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:39:22.233707 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-b632394e-efe9-4f96-8a03-9b9d3af64a3a tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] 10.222.0.45 "GET /compute/v2.1/servers/bc1c3d0f-0474-4bad-b8a1-7c7d169b6ad0" status: 200 len: 1514 microversion: 2.1 time: 0.192222 Jan 21 09:39:22.234493 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 328/652] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:39:22 2022] GET /compute/v2.1/servers/bc1c3d0f-0474-4bad-b8a1-7c7d169b6ad0 => generated 1514 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 09:39:22.250309 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-b00b5a61-d259-4b8c-8510-8378444ef63b tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:39:22.250814 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-b00b5a61-d259-4b8c-8510-8378444ef63b tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] [instance: 06ae865a-6ba5-4198-be6d-e6056e645411] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:39:22.257448 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-b00b5a61-d259-4b8c-8510-8378444ef63b tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:39:22.257908 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-b00b5a61-d259-4b8c-8510-8378444ef63b tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:39:22.258690 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-b00b5a61-d259-4b8c-8510-8378444ef63b tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:39:22.259127 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-b00b5a61-d259-4b8c-8510-8378444ef63b tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:39:22.284826 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-b00b5a61-d259-4b8c-8510-8378444ef63b tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] [instance: 06ae865a-6ba5-4198-be6d-e6056e645411] Going to try to terminate instance {{(pid=123386) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 21 09:39:22.512219 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-8f222837-1e52-4eb3-b0b1-18a7cfdceae0 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:39:22.512890 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-8f222837-1e52-4eb3-b0b1-18a7cfdceae0 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] [instance: 59ad64a5-af93-44ef-8031-fd2f2d18a901] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:39:22.519722 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-8f222837-1e52-4eb3-b0b1-18a7cfdceae0 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:39:22.520161 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-8f222837-1e52-4eb3-b0b1-18a7cfdceae0 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:39:22.521444 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-8f222837-1e52-4eb3-b0b1-18a7cfdceae0 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:39:22.521900 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-8f222837-1e52-4eb3-b0b1-18a7cfdceae0 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:39:22.620000 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-b00b5a61-d259-4b8c-8510-8378444ef63b tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] 10.222.0.45 "DELETE /compute/v2.1/servers/06ae865a-6ba5-4198-be6d-e6056e645411" status: 204 len: 0 microversion: 2.1 time: 0.372348 Jan 21 09:39:22.624593 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 325/653] 10.222.0.45 () {58 vars in 1238 bytes} [Fri Jan 21 09:39:22 2022] DELETE /compute/v2.1/servers/06ae865a-6ba5-4198-be6d-e6056e645411 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 21 09:39:22.634269 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-acec047e-19c0-40c2-b3eb-51e4e3acdd0b tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:39:22.634978 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-acec047e-19c0-40c2-b3eb-51e4e3acdd0b tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] [instance: 06ae865a-6ba5-4198-be6d-e6056e645411] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:39:22.659791 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-acec047e-19c0-40c2-b3eb-51e4e3acdd0b tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:39:22.660248 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-acec047e-19c0-40c2-b3eb-51e4e3acdd0b tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:39:22.661058 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-acec047e-19c0-40c2-b3eb-51e4e3acdd0b tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:39:22.677199 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-acec047e-19c0-40c2-b3eb-51e4e3acdd0b tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:39:22.810586 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-8f222837-1e52-4eb3-b0b1-18a7cfdceae0 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:39:22.819714 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-8f222837-1e52-4eb3-b0b1-18a7cfdceae0 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:39:22.821338 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-8f222837-1e52-4eb3-b0b1-18a7cfdceae0 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:39:22.822533 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-8f222837-1e52-4eb3-b0b1-18a7cfdceae0 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "GET /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901" status: 200 len: 1808 microversion: 2.20 time: 0.314374 Jan 21 09:39:22.823152 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 329/654] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jan 21 09:39:22 2022] GET /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901 => generated 1808 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 21 09:39:22.879041 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-acec047e-19c0-40c2-b3eb-51e4e3acdd0b tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db87258db1424ce7a8399fdd05efe3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89d1b21ad8471a8a9a82adac2594c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:39:22.886441 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-acec047e-19c0-40c2-b3eb-51e4e3acdd0b tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] 10.222.0.45 "GET /compute/v2.1/servers/06ae865a-6ba5-4198-be6d-e6056e645411" status: 200 len: 1508 microversion: 2.1 time: 0.260570 Jan 21 09:39:22.887012 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 326/655] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:39:22 2022] GET /compute/v2.1/servers/06ae865a-6ba5-4198-be6d-e6056e645411 => generated 1508 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:39:23.152267 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-1a84e0e2-5384-45e6-8f85-44ba8b8fd429 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:39:23.153597 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-1a84e0e2-5384-45e6-8f85-44ba8b8fd429 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] [instance: 2733931f-f68e-4f48-85d2-5060a8f55eec] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:39:23.192366 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-1a84e0e2-5384-45e6-8f85-44ba8b8fd429 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:39:23.192905 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-1a84e0e2-5384-45e6-8f85-44ba8b8fd429 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:39:23.194752 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-1a84e0e2-5384-45e6-8f85-44ba8b8fd429 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:39:23.195394 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-1a84e0e2-5384-45e6-8f85-44ba8b8fd429 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:39:23.254369 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-2e87c910-d173-48cc-afe2-b683fa437463 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:39:23.255184 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-2e87c910-d173-48cc-afe2-b683fa437463 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] [instance: bc1c3d0f-0474-4bad-b8a1-7c7d169b6ad0] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:39:23.266516 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-2e87c910-d173-48cc-afe2-b683fa437463 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:39:23.266963 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-2e87c910-d173-48cc-afe2-b683fa437463 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:39:23.268333 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-2e87c910-d173-48cc-afe2-b683fa437463 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:39:23.268766 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-2e87c910-d173-48cc-afe2-b683fa437463 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:39:23.292114 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-1a84e0e2-5384-45e6-8f85-44ba8b8fd429 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d53a7fa2cb5498aa916817b82dba77e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515ded26ca114fbf9c6e920362aec64c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:39:23.304238 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-1a84e0e2-5384-45e6-8f85-44ba8b8fd429 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] 10.222.0.45 "GET /compute/v2.1/servers/2733931f-f68e-4f48-85d2-5060a8f55eec" status: 200 len: 1210 microversion: 2.1 time: 0.153951 Jan 21 09:39:23.307340 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 330/656] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:39:23 2022] GET /compute/v2.1/servers/2733931f-f68e-4f48-85d2-5060a8f55eec => generated 1210 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:39:23.317753 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [req-32fa85d6-a6a7-4b61-a41e-4a3c1593405e req-046155c4-61d9-474a-889c-a80cd2da7d19 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59ad64a5-af93-44ef-8031-fd2f2d18a901", "name": "network-vif-plugged", "status": "completed", "tag": "63990fa3-fce3-4891-adb2-cd4ebc4c075a"}]} {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:39:23.319550 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 21 09:39:23.319550 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: warnings.warn(msg) Jan 21 09:39:23.327380 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [req-32fa85d6-a6a7-4b61-a41e-4a3c1593405e req-046155c4-61d9-474a-889c-a80cd2da7d19 service nova] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:39:23.327836 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [req-32fa85d6-a6a7-4b61-a41e-4a3c1593405e req-046155c4-61d9-474a-889c-a80cd2da7d19 service nova] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:39:23.341291 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.compute.server_external_events [req-32fa85d6-a6a7-4b61-a41e-4a3c1593405e req-046155c4-61d9-474a-889c-a80cd2da7d19 service nova] Creating event network-vif-plugged:63990fa3-fce3-4891-adb2-cd4ebc4c075a for instance 59ad64a5-af93-44ef-8031-fd2f2d18a901 on hv-cinder-80403 Jan 21 09:39:23.347227 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [req-32fa85d6-a6a7-4b61-a41e-4a3c1593405e req-046155c4-61d9-474a-889c-a80cd2da7d19 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038702 Jan 21 09:39:23.347827 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 331/657] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Jan 21 09:39:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 09:39:23.480534 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-2e87c910-d173-48cc-afe2-b683fa437463 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7b2c14d9444d65ab7a874e749671bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3390729231b409e9a83376b428c1a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:39:23.490144 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-2e87c910-d173-48cc-afe2-b683fa437463 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] 10.222.0.45 "GET /compute/v2.1/servers/bc1c3d0f-0474-4bad-b8a1-7c7d169b6ad0" status: 200 len: 1514 microversion: 2.1 time: 0.241281 Jan 21 09:39:23.491105 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 327/658] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:39:23 2022] GET /compute/v2.1/servers/bc1c3d0f-0474-4bad-b8a1-7c7d169b6ad0 => generated 1514 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 09:39:23.842476 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-4d9cb120-d923-446d-b85d-10107e79f457 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:39:23.843501 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-4d9cb120-d923-446d-b85d-10107e79f457 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] [instance: 59ad64a5-af93-44ef-8031-fd2f2d18a901] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:39:23.856043 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-4d9cb120-d923-446d-b85d-10107e79f457 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:39:23.856930 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-4d9cb120-d923-446d-b85d-10107e79f457 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:39:23.859524 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-4d9cb120-d923-446d-b85d-10107e79f457 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:39:23.859524 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-4d9cb120-d923-446d-b85d-10107e79f457 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:39:23.905499 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-a1d0f11b-8061-45c1-9dce-509f10828ff6 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:39:23.906453 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-a1d0f11b-8061-45c1-9dce-509f10828ff6 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] [instance: 06ae865a-6ba5-4198-be6d-e6056e645411] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:39:23.913353 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-a1d0f11b-8061-45c1-9dce-509f10828ff6 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:39:23.915234 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-a1d0f11b-8061-45c1-9dce-509f10828ff6 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:39:23.915234 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-a1d0f11b-8061-45c1-9dce-509f10828ff6 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:39:23.915234 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-a1d0f11b-8061-45c1-9dce-509f10828ff6 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:39:24.345754 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-4d9cb120-d923-446d-b85d-10107e79f457 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:39:24.354513 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-a1d0f11b-8061-45c1-9dce-509f10828ff6 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db87258db1424ce7a8399fdd05efe3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89d1b21ad8471a8a9a82adac2594c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:39:24.355061 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-4d9cb120-d923-446d-b85d-10107e79f457 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:39:24.356545 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-4d9cb120-d923-446d-b85d-10107e79f457 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:39:24.357907 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-4d9cb120-d923-446d-b85d-10107e79f457 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "GET /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901" status: 200 len: 1808 microversion: 2.20 time: 0.520041 Jan 21 09:39:24.358945 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 332/659] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jan 21 09:39:23 2022] GET /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901 => generated 1808 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 21 09:39:24.364383 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-a1d0f11b-8061-45c1-9dce-509f10828ff6 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] 10.222.0.45 "GET /compute/v2.1/servers/06ae865a-6ba5-4198-be6d-e6056e645411" status: 200 len: 1508 microversion: 2.1 time: 0.463135 Jan 21 09:39:24.364999 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-6289d8f8-1748-481b-8965-0db5c5e9fcdd tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:39:24.365298 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 328/660] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:39:23 2022] GET /compute/v2.1/servers/06ae865a-6ba5-4198-be6d-e6056e645411 => generated 1508 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:39:24.365810 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-6289d8f8-1748-481b-8965-0db5c5e9fcdd tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] [instance: 2733931f-f68e-4f48-85d2-5060a8f55eec] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:39:24.372434 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-6289d8f8-1748-481b-8965-0db5c5e9fcdd tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:39:24.372968 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-6289d8f8-1748-481b-8965-0db5c5e9fcdd tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:39:24.373708 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-6289d8f8-1748-481b-8965-0db5c5e9fcdd tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:39:24.374120 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-6289d8f8-1748-481b-8965-0db5c5e9fcdd tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:39:24.509549 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-b6123e6f-8fe5-4234-b266-a2ba67c77010 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:39:24.511257 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-b6123e6f-8fe5-4234-b266-a2ba67c77010 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] [instance: bc1c3d0f-0474-4bad-b8a1-7c7d169b6ad0] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:39:24.523525 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-b6123e6f-8fe5-4234-b266-a2ba67c77010 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:39:24.525404 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-b6123e6f-8fe5-4234-b266-a2ba67c77010 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:39:24.526425 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-b6123e6f-8fe5-4234-b266-a2ba67c77010 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:39:24.527058 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-b6123e6f-8fe5-4234-b266-a2ba67c77010 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:39:24.663430 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-b6123e6f-8fe5-4234-b266-a2ba67c77010 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7b2c14d9444d65ab7a874e749671bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3390729231b409e9a83376b428c1a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:39:24.671565 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-b6123e6f-8fe5-4234-b266-a2ba67c77010 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] 10.222.0.45 "GET /compute/v2.1/servers/bc1c3d0f-0474-4bad-b8a1-7c7d169b6ad0" status: 200 len: 1472 microversion: 2.1 time: 0.167027 Jan 21 09:39:24.672726 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 329/661] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:39:24 2022] GET /compute/v2.1/servers/bc1c3d0f-0474-4bad-b8a1-7c7d169b6ad0 => generated 1472 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 09:39:24.678661 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [req-861086da-9098-4c31-b668-7d798f8faa24 req-ec855f4b-9ea7-4dbf-a5e9-7143344b0733 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc1c3d0f-0474-4bad-b8a1-7c7d169b6ad0", "name": "network-vif-deleted", "tag": "81cdcb77-b728-4dac-a9d7-2fe131466b38"}]} {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:39:24.681211 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 21 09:39:24.681211 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: warnings.warn(msg) Jan 21 09:39:24.696662 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [req-861086da-9098-4c31-b668-7d798f8faa24 req-ec855f4b-9ea7-4dbf-a5e9-7143344b0733 service nova] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:39:24.696662 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [req-861086da-9098-4c31-b668-7d798f8faa24 req-ec855f4b-9ea7-4dbf-a5e9-7143344b0733 service nova] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:39:24.701424 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-6289d8f8-1748-481b-8965-0db5c5e9fcdd tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d53a7fa2cb5498aa916817b82dba77e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515ded26ca114fbf9c6e920362aec64c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:39:24.706540 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.compute.server_external_events [req-861086da-9098-4c31-b668-7d798f8faa24 req-ec855f4b-9ea7-4dbf-a5e9-7143344b0733 service nova] Creating event network-vif-deleted:81cdcb77-b728-4dac-a9d7-2fe131466b38 for instance bc1c3d0f-0474-4bad-b8a1-7c7d169b6ad0 on hv-cinder-80403 Jan 21 09:39:24.710138 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-6289d8f8-1748-481b-8965-0db5c5e9fcdd tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] 10.222.0.45 "GET /compute/v2.1/servers/2733931f-f68e-4f48-85d2-5060a8f55eec" status: 200 len: 1265 microversion: 2.1 time: 0.349916 Jan 21 09:39:24.710728 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 333/662] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:39:24 2022] GET /compute/v2.1/servers/2733931f-f68e-4f48-85d2-5060a8f55eec => generated 1265 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:39:24.723199 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [req-861086da-9098-4c31-b668-7d798f8faa24 req-ec855f4b-9ea7-4dbf-a5e9-7143344b0733 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048640 Jan 21 09:39:24.725525 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 330/663] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Jan 21 09:39:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 09:39:25.378747 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-2a8ae4ce-7c1c-42f7-a28b-c437b479c3f2 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:39:25.380142 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-2a8ae4ce-7c1c-42f7-a28b-c437b479c3f2 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] [instance: 59ad64a5-af93-44ef-8031-fd2f2d18a901] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:39:25.382550 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-ef361b46-0220-455f-8f71-e2c1ef3347a3 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:39:25.383922 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-ef361b46-0220-455f-8f71-e2c1ef3347a3 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] [instance: 06ae865a-6ba5-4198-be6d-e6056e645411] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:39:25.390562 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-ef361b46-0220-455f-8f71-e2c1ef3347a3 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:39:25.391013 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-ef361b46-0220-455f-8f71-e2c1ef3347a3 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:39:25.391981 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-ef361b46-0220-455f-8f71-e2c1ef3347a3 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:39:25.393489 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-ef361b46-0220-455f-8f71-e2c1ef3347a3 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:39:25.393914 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-2a8ae4ce-7c1c-42f7-a28b-c437b479c3f2 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:39:25.394388 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-2a8ae4ce-7c1c-42f7-a28b-c437b479c3f2 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:39:25.397471 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-2a8ae4ce-7c1c-42f7-a28b-c437b479c3f2 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:39:25.397471 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-2a8ae4ce-7c1c-42f7-a28b-c437b479c3f2 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:39:25.942301 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-ef361b46-0220-455f-8f71-e2c1ef3347a3 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db87258db1424ce7a8399fdd05efe3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89d1b21ad8471a8a9a82adac2594c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:39:25.950288 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-ef361b46-0220-455f-8f71-e2c1ef3347a3 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] 10.222.0.45 "GET /compute/v2.1/servers/06ae865a-6ba5-4198-be6d-e6056e645411" status: 200 len: 1508 microversion: 2.1 time: 0.572164 Jan 21 09:39:25.951337 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 331/664] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:39:25 2022] GET /compute/v2.1/servers/06ae865a-6ba5-4198-be6d-e6056e645411 => generated 1508 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 09:39:25.953127 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-2a8ae4ce-7c1c-42f7-a28b-c437b479c3f2 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:39:25.956828 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-fb0332a0-f82d-48b4-aab3-d87636aa16e6 tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:39:25.957532 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-fb0332a0-f82d-48b4-aab3-d87636aa16e6 tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] [instance: 6104a6dc-afee-486a-a867-490dad16c883] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:39:25.964500 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-fb0332a0-f82d-48b4-aab3-d87636aa16e6 tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:39:25.964948 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-fb0332a0-f82d-48b4-aab3-d87636aa16e6 tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:39:25.966687 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-fb0332a0-f82d-48b4-aab3-d87636aa16e6 tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:39:25.967128 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-fb0332a0-f82d-48b4-aab3-d87636aa16e6 tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:39:25.969891 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-2a8ae4ce-7c1c-42f7-a28b-c437b479c3f2 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:39:25.979746 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-2a8ae4ce-7c1c-42f7-a28b-c437b479c3f2 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:39:25.981521 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-2a8ae4ce-7c1c-42f7-a28b-c437b479c3f2 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "GET /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901" status: 200 len: 1808 microversion: 2.20 time: 0.607776 Jan 21 09:39:25.982548 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 334/665] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jan 21 09:39:25 2022] GET /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901 => generated 1808 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 21 09:39:25.988600 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-11626519-d946-4b4e-9c4f-289933be776e tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:39:25.989325 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-11626519-d946-4b4e-9c4f-289933be776e tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] [instance: bc1c3d0f-0474-4bad-b8a1-7c7d169b6ad0] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:39:25.997167 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-11626519-d946-4b4e-9c4f-289933be776e tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:39:25.997828 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-11626519-d946-4b4e-9c4f-289933be776e tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:39:25.998841 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-11626519-d946-4b4e-9c4f-289933be776e tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:39:25.999473 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-11626519-d946-4b4e-9c4f-289933be776e tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:39:26.020366 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.wsgi [None req-11626519-d946-4b4e-9c4f-289933be776e tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] HTTP exception thrown: Instance bc1c3d0f-0474-4bad-b8a1-7c7d169b6ad0 could not be found. Jan 21 09:39:26.021165 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-11626519-d946-4b4e-9c4f-289933be776e tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Returning 404 to user: Instance bc1c3d0f-0474-4bad-b8a1-7c7d169b6ad0 could not be found. {{(pid=123387) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 21 09:39:26.022022 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-11626519-d946-4b4e-9c4f-289933be776e tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] 10.222.0.45 "GET /compute/v2.1/servers/bc1c3d0f-0474-4bad-b8a1-7c7d169b6ad0" status: 404 len: 111 microversion: 2.1 time: 0.038307 Jan 21 09:39:26.022573 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 335/666] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:39:25 2022] GET /compute/v2.1/servers/bc1c3d0f-0474-4bad-b8a1-7c7d169b6ad0 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 21 09:39:26.035100 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-7f88dfa0-642d-4d96-a96f-26029e65b27a tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:39:26.035731 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-7f88dfa0-642d-4d96-a96f-26029e65b27a tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] [instance: 2733931f-f68e-4f48-85d2-5060a8f55eec] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:39:26.041694 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-7f88dfa0-642d-4d96-a96f-26029e65b27a tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:39:26.042399 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-7f88dfa0-642d-4d96-a96f-26029e65b27a tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:39:26.043775 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-7f88dfa0-642d-4d96-a96f-26029e65b27a tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:39:26.044370 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-7f88dfa0-642d-4d96-a96f-26029e65b27a tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:39:26.107165 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.objects.instance [None req-fb0332a0-f82d-48b4-aab3-d87636aa16e6 tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Lazy-loading 'services' on Instance uuid 6104a6dc-afee-486a-a867-490dad16c883 {{(pid=123386) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 21 09:39:26.220392 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-7f88dfa0-642d-4d96-a96f-26029e65b27a tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d53a7fa2cb5498aa916817b82dba77e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515ded26ca114fbf9c6e920362aec64c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:39:26.228065 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-7f88dfa0-642d-4d96-a96f-26029e65b27a tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] 10.222.0.45 "GET /compute/v2.1/servers/2733931f-f68e-4f48-85d2-5060a8f55eec" status: 200 len: 1265 microversion: 2.1 time: 0.203749 Jan 21 09:39:26.228671 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 336/667] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:39:26 2022] GET /compute/v2.1/servers/2733931f-f68e-4f48-85d2-5060a8f55eec => generated 1265 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:39:26.593251 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-fb0332a0-f82d-48b4-aab3-d87636aa16e6 tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] 10.222.0.45 "DELETE /compute/v2.1/servers/6104a6dc-afee-486a-a867-490dad16c883/os-volume_attachments/c9765ef0-8cc7-40c2-b03d-cad6156ec614" status: 202 len: 0 microversion: 2.1 time: 0.637498 Jan 21 09:39:26.593251 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 332/668] 10.222.0.45 () {58 vars in 1415 bytes} [Fri Jan 21 09:39:25 2022] DELETE /compute/v2.1/servers/6104a6dc-afee-486a-a867-490dad16c883/os-volume_attachments/c9765ef0-8cc7-40c2-b03d-cad6156ec614 => generated 0 bytes in 639 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 21 09:39:26.744119 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [req-a02e7c96-2a43-4f1b-b9e0-1d07e6222718 req-88bd4424-0d21-4efc-a265-4c84c78d4323 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2733931f-f68e-4f48-85d2-5060a8f55eec", "tag": "fdcd5489-3e9c-4a62-8bc8-26a5c193cc04"}]} {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:39:26.756052 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 21 09:39:26.756052 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: warnings.warn(msg) Jan 21 09:39:26.756052 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [req-a02e7c96-2a43-4f1b-b9e0-1d07e6222718 req-88bd4424-0d21-4efc-a265-4c84c78d4323 service nova] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:39:26.756052 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [req-a02e7c96-2a43-4f1b-b9e0-1d07e6222718 req-88bd4424-0d21-4efc-a265-4c84c78d4323 service nova] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:39:26.766926 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.compute.server_external_events [req-a02e7c96-2a43-4f1b-b9e0-1d07e6222718 req-88bd4424-0d21-4efc-a265-4c84c78d4323 service nova] Creating event network-changed:fdcd5489-3e9c-4a62-8bc8-26a5c193cc04 for instance 2733931f-f68e-4f48-85d2-5060a8f55eec on hv-cinder-80403 Jan 21 09:39:26.772532 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [req-a02e7c96-2a43-4f1b-b9e0-1d07e6222718 req-88bd4424-0d21-4efc-a265-4c84c78d4323 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031973 Jan 21 09:39:26.773476 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 337/669] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Jan 21 09:39:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 09:39:26.968425 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-d288891a-e868-4340-a6cd-6eb0be99a41b tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:39:26.969272 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-d288891a-e868-4340-a6cd-6eb0be99a41b tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] [instance: 06ae865a-6ba5-4198-be6d-e6056e645411] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:39:26.976000 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-d288891a-e868-4340-a6cd-6eb0be99a41b tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:39:26.976598 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-d288891a-e868-4340-a6cd-6eb0be99a41b tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:39:26.977605 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-d288891a-e868-4340-a6cd-6eb0be99a41b tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:39:26.978116 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-d288891a-e868-4340-a6cd-6eb0be99a41b tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:39:27.005698 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-25ff4621-1f73-49e7-85a7-baec5876e14d tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:39:27.007260 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-25ff4621-1f73-49e7-85a7-baec5876e14d tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] [instance: 59ad64a5-af93-44ef-8031-fd2f2d18a901] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:39:27.023433 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-25ff4621-1f73-49e7-85a7-baec5876e14d tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:39:27.024022 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-25ff4621-1f73-49e7-85a7-baec5876e14d tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:39:27.024784 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-25ff4621-1f73-49e7-85a7-baec5876e14d tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:39:27.025568 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-25ff4621-1f73-49e7-85a7-baec5876e14d tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:39:27.453118 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-d288891a-e868-4340-a6cd-6eb0be99a41b tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db87258db1424ce7a8399fdd05efe3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89d1b21ad8471a8a9a82adac2594c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:39:27.463380 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-d288891a-e868-4340-a6cd-6eb0be99a41b tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] 10.222.0.45 "GET /compute/v2.1/servers/06ae865a-6ba5-4198-be6d-e6056e645411" status: 200 len: 1508 microversion: 2.1 time: 0.498864 Jan 21 09:39:27.474154 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 333/670] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:39:26 2022] GET /compute/v2.1/servers/06ae865a-6ba5-4198-be6d-e6056e645411 => generated 1508 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:39:27.479252 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-5f1a5c6b-fe00-41f6-9ad9-b8ac678fc66f tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:39:27.480109 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-5f1a5c6b-fe00-41f6-9ad9-b8ac678fc66f tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] [instance: 2733931f-f68e-4f48-85d2-5060a8f55eec] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:39:27.490750 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-5f1a5c6b-fe00-41f6-9ad9-b8ac678fc66f tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:39:27.491851 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-5f1a5c6b-fe00-41f6-9ad9-b8ac678fc66f tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:39:27.492817 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-5f1a5c6b-fe00-41f6-9ad9-b8ac678fc66f tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:39:27.493438 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-5f1a5c6b-fe00-41f6-9ad9-b8ac678fc66f tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:39:27.499918 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-25ff4621-1f73-49e7-85a7-baec5876e14d tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:39:27.511060 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-25ff4621-1f73-49e7-85a7-baec5876e14d tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:39:27.513086 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-25ff4621-1f73-49e7-85a7-baec5876e14d tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:39:27.525982 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-25ff4621-1f73-49e7-85a7-baec5876e14d tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "GET /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901" status: 200 len: 1808 microversion: 2.20 time: 0.514736 Jan 21 09:39:27.525982 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 338/671] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jan 21 09:39:26 2022] GET /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901 => generated 1808 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 21 09:39:27.570667 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-3f042c85-1ff4-446b-8c53-030473ffbc86 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:39:27.573018 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-3f042c85-1ff4-446b-8c53-030473ffbc86 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] [instance: 370b78d2-d154-4c93-b8ef-3723bd26c3d4] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:39:27.578387 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-3f042c85-1ff4-446b-8c53-030473ffbc86 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:39:27.578834 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-3f042c85-1ff4-446b-8c53-030473ffbc86 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:39:27.579685 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-3f042c85-1ff4-446b-8c53-030473ffbc86 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:39:27.580787 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-3f042c85-1ff4-446b-8c53-030473ffbc86 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:39:27.616215 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-3f042c85-1ff4-446b-8c53-030473ffbc86 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] [instance: 370b78d2-d154-4c93-b8ef-3723bd26c3d4] Going to try to terminate instance {{(pid=123387) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 21 09:39:27.897326 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-3f042c85-1ff4-446b-8c53-030473ffbc86 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] 10.222.0.45 "DELETE /compute/v2.1/servers/370b78d2-d154-4c93-b8ef-3723bd26c3d4" status: 204 len: 0 microversion: 2.1 time: 0.328727 Jan 21 09:39:27.907074 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 339/672] 10.222.0.45 () {58 vars in 1238 bytes} [Fri Jan 21 09:39:27 2022] DELETE /compute/v2.1/servers/370b78d2-d154-4c93-b8ef-3723bd26c3d4 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jan 21 09:39:27.909203 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-87bb1e6d-f46d-4027-a5be-712adbe8e844 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:39:27.910191 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-87bb1e6d-f46d-4027-a5be-712adbe8e844 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] [instance: 370b78d2-d154-4c93-b8ef-3723bd26c3d4] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:39:27.917223 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-87bb1e6d-f46d-4027-a5be-712adbe8e844 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:39:27.917919 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-87bb1e6d-f46d-4027-a5be-712adbe8e844 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:39:27.918236 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-5f1a5c6b-fe00-41f6-9ad9-b8ac678fc66f tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d53a7fa2cb5498aa916817b82dba77e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515ded26ca114fbf9c6e920362aec64c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:39:27.919539 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-87bb1e6d-f46d-4027-a5be-712adbe8e844 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:39:27.920145 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-87bb1e6d-f46d-4027-a5be-712adbe8e844 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:39:27.934167 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-5f1a5c6b-fe00-41f6-9ad9-b8ac678fc66f tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] 10.222.0.45 "GET /compute/v2.1/servers/2733931f-f68e-4f48-85d2-5060a8f55eec" status: 200 len: 1265 microversion: 2.1 time: 0.456154 Jan 21 09:39:27.935586 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 334/673] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:39:27 2022] GET /compute/v2.1/servers/2733931f-f68e-4f48-85d2-5060a8f55eec => generated 1265 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:39:28.084903 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-87bb1e6d-f46d-4027-a5be-712adbe8e844 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7b2c14d9444d65ab7a874e749671bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3390729231b409e9a83376b428c1a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:39:28.097228 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-87bb1e6d-f46d-4027-a5be-712adbe8e844 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] 10.222.0.45 "GET /compute/v2.1/servers/370b78d2-d154-4c93-b8ef-3723bd26c3d4" status: 200 len: 1514 microversion: 2.1 time: 0.193715 Jan 21 09:39:28.097823 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 340/674] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:39:27 2022] GET /compute/v2.1/servers/370b78d2-d154-4c93-b8ef-3723bd26c3d4 => generated 1514 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:39:28.480071 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-03ddc967-04f4-4ca5-8cb6-8146c544d417 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:39:28.480585 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-03ddc967-04f4-4ca5-8cb6-8146c544d417 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] [instance: 06ae865a-6ba5-4198-be6d-e6056e645411] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:39:28.488574 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-03ddc967-04f4-4ca5-8cb6-8146c544d417 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:39:28.489029 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-03ddc967-04f4-4ca5-8cb6-8146c544d417 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:39:28.489855 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-03ddc967-04f4-4ca5-8cb6-8146c544d417 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:39:28.490423 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-03ddc967-04f4-4ca5-8cb6-8146c544d417 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:39:28.527162 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-03ddc967-04f4-4ca5-8cb6-8146c544d417 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:39:28.527642 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-03ddc967-04f4-4ca5-8cb6-8146c544d417 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:39:28.528061 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.objects.instance [None req-03ddc967-04f4-4ca5-8cb6-8146c544d417 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lazy-loading 'fault' on Instance uuid 06ae865a-6ba5-4198-be6d-e6056e645411 {{(pid=123386) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 21 09:39:28.533337 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-18df7d74-dc26-490e-b717-7c31019005e7 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:39:28.534125 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-18df7d74-dc26-490e-b717-7c31019005e7 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] [instance: 59ad64a5-af93-44ef-8031-fd2f2d18a901] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:39:28.540090 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-18df7d74-dc26-490e-b717-7c31019005e7 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:39:28.540532 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-18df7d74-dc26-490e-b717-7c31019005e7 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:39:28.541336 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-18df7d74-dc26-490e-b717-7c31019005e7 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:39:28.542107 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-18df7d74-dc26-490e-b717-7c31019005e7 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:39:28.568500 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-03ddc967-04f4-4ca5-8cb6-8146c544d417 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db87258db1424ce7a8399fdd05efe3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89d1b21ad8471a8a9a82adac2594c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:39:28.576193 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-03ddc967-04f4-4ca5-8cb6-8146c544d417 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] 10.222.0.45 "GET /compute/v2.1/servers/06ae865a-6ba5-4198-be6d-e6056e645411" status: 200 len: 1312 microversion: 2.1 time: 0.099885 Jan 21 09:39:28.576955 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 335/675] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:39:28 2022] GET /compute/v2.1/servers/06ae865a-6ba5-4198-be6d-e6056e645411 => generated 1312 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:39:28.686780 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-18df7d74-dc26-490e-b717-7c31019005e7 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:39:28.695560 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-18df7d74-dc26-490e-b717-7c31019005e7 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:39:28.697137 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-18df7d74-dc26-490e-b717-7c31019005e7 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:39:28.698295 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-18df7d74-dc26-490e-b717-7c31019005e7 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "GET /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901" status: 200 len: 1795 microversion: 2.20 time: 0.168777 Jan 21 09:39:28.698857 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 341/676] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jan 21 09:39:28 2022] GET /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901 => generated 1795 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 21 09:39:28.788271 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-73c5a540-cbda-40ff-9c67-534786adcead tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:39:28.788686 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [req-a85b0c2a-53e6-4e57-81e7-d7808f335dfa req-e050b62f-67d8-401c-8ed3-939c0d53694e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06ae865a-6ba5-4198-be6d-e6056e645411", "name": "network-vif-deleted", "tag": "2b16cf8c-7e83-4177-a9ae-f7516c48e617"}]} {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:39:28.788817 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-73c5a540-cbda-40ff-9c67-534786adcead tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] [instance: 6104a6dc-afee-486a-a867-490dad16c883] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:39:28.790425 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 21 09:39:28.790425 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: warnings.warn(msg) Jan 21 09:39:28.794969 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-73c5a540-cbda-40ff-9c67-534786adcead tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:39:28.795422 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-73c5a540-cbda-40ff-9c67-534786adcead tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:39:28.796761 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-73c5a540-cbda-40ff-9c67-534786adcead tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:39:28.797235 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-73c5a540-cbda-40ff-9c67-534786adcead tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:39:28.797728 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [req-a85b0c2a-53e6-4e57-81e7-d7808f335dfa req-e050b62f-67d8-401c-8ed3-939c0d53694e service nova] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:39:28.798202 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [req-a85b0c2a-53e6-4e57-81e7-d7808f335dfa req-e050b62f-67d8-401c-8ed3-939c0d53694e service nova] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:39:28.810887 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.compute.server_external_events [req-a85b0c2a-53e6-4e57-81e7-d7808f335dfa req-e050b62f-67d8-401c-8ed3-939c0d53694e service nova] Creating event network-vif-deleted:2b16cf8c-7e83-4177-a9ae-f7516c48e617 for instance 06ae865a-6ba5-4198-be6d-e6056e645411 on hv-cinder-80403 Jan 21 09:39:28.818879 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [req-a85b0c2a-53e6-4e57-81e7-d7808f335dfa req-e050b62f-67d8-401c-8ed3-939c0d53694e service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033859 Jan 21 09:39:28.819506 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 342/677] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Jan 21 09:39:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 09:39:28.825111 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-73c5a540-cbda-40ff-9c67-534786adcead tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] [instance: 6104a6dc-afee-486a-a867-490dad16c883] Going to try to terminate instance {{(pid=123386) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 21 09:39:28.953412 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-1e8efea2-2f72-4747-bdea-2cfe40c9258b tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:39:28.954108 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-1e8efea2-2f72-4747-bdea-2cfe40c9258b tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] [instance: 2733931f-f68e-4f48-85d2-5060a8f55eec] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:39:28.960237 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-1e8efea2-2f72-4747-bdea-2cfe40c9258b tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:39:28.960793 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-1e8efea2-2f72-4747-bdea-2cfe40c9258b tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:39:28.961622 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-1e8efea2-2f72-4747-bdea-2cfe40c9258b tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:39:28.962150 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-1e8efea2-2f72-4747-bdea-2cfe40c9258b tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:39:29.133456 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-1e8efea2-2f72-4747-bdea-2cfe40c9258b tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d53a7fa2cb5498aa916817b82dba77e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515ded26ca114fbf9c6e920362aec64c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:39:29.140172 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-1e8efea2-2f72-4747-bdea-2cfe40c9258b tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] 10.222.0.45 "GET /compute/v2.1/servers/2733931f-f68e-4f48-85d2-5060a8f55eec" status: 200 len: 1265 microversion: 2.1 time: 0.190636 Jan 21 09:39:29.141456 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 343/678] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:39:28 2022] GET /compute/v2.1/servers/2733931f-f68e-4f48-85d2-5060a8f55eec => generated 1265 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 09:39:29.144517 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-73c5a540-cbda-40ff-9c67-534786adcead tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] 10.222.0.45 "DELETE /compute/v2.1/servers/6104a6dc-afee-486a-a867-490dad16c883" status: 204 len: 0 microversion: 2.1 time: 0.360140 Jan 21 09:39:29.145920 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 336/679] 10.222.0.45 () {58 vars in 1238 bytes} [Fri Jan 21 09:39:28 2022] DELETE /compute/v2.1/servers/6104a6dc-afee-486a-a867-490dad16c883 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 21 09:39:29.148260 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-4c50aaa0-1967-41ba-b43f-4584f7eefba8 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:39:29.153284 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-4c50aaa0-1967-41ba-b43f-4584f7eefba8 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] [instance: 370b78d2-d154-4c93-b8ef-3723bd26c3d4] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:39:29.159535 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-7363b461-9d1e-4267-949d-387c3ef6e4bc tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:39:29.160454 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-7363b461-9d1e-4267-949d-387c3ef6e4bc tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] [instance: 6104a6dc-afee-486a-a867-490dad16c883] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:39:29.162042 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-4c50aaa0-1967-41ba-b43f-4584f7eefba8 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:39:29.163540 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-4c50aaa0-1967-41ba-b43f-4584f7eefba8 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:39:29.165320 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-4c50aaa0-1967-41ba-b43f-4584f7eefba8 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:39:29.166101 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-4c50aaa0-1967-41ba-b43f-4584f7eefba8 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:39:29.169479 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-7363b461-9d1e-4267-949d-387c3ef6e4bc tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:39:29.169936 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-7363b461-9d1e-4267-949d-387c3ef6e4bc tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:39:29.170745 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-7363b461-9d1e-4267-949d-387c3ef6e4bc tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:39:29.171182 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-7363b461-9d1e-4267-949d-387c3ef6e4bc tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:39:29.441206 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-7363b461-9d1e-4267-949d-387c3ef6e4bc tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498146f6a6814129b393e7084057bfd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db07feb3a43432999da539b6b85fb2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:39:29.449090 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-7363b461-9d1e-4267-949d-387c3ef6e4bc tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] 10.222.0.45 "GET /compute/v2.1/servers/6104a6dc-afee-486a-a867-490dad16c883" status: 200 len: 1514 microversion: 2.1 time: 0.293865 Jan 21 09:39:29.450004 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 337/680] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:39:29 2022] GET /compute/v2.1/servers/6104a6dc-afee-486a-a867-490dad16c883 => generated 1514 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 09:39:29.451098 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-4c50aaa0-1967-41ba-b43f-4584f7eefba8 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7b2c14d9444d65ab7a874e749671bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3390729231b409e9a83376b428c1a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:39:29.459213 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-4c50aaa0-1967-41ba-b43f-4584f7eefba8 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] 10.222.0.45 "GET /compute/v2.1/servers/370b78d2-d154-4c93-b8ef-3723bd26c3d4" status: 200 len: 1514 microversion: 2.1 time: 0.316841 Jan 21 09:39:29.459797 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 344/681] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:39:29 2022] GET /compute/v2.1/servers/370b78d2-d154-4c93-b8ef-3723bd26c3d4 => generated 1514 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:39:29.594096 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-695b1fc1-55f1-4e4f-849b-f44c7977916d tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:39:29.594621 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-695b1fc1-55f1-4e4f-849b-f44c7977916d tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] [instance: 06ae865a-6ba5-4198-be6d-e6056e645411] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:39:29.601755 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-695b1fc1-55f1-4e4f-849b-f44c7977916d tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:39:29.602202 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-695b1fc1-55f1-4e4f-849b-f44c7977916d tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:39:29.602981 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-695b1fc1-55f1-4e4f-849b-f44c7977916d tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:39:29.603416 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-695b1fc1-55f1-4e4f-849b-f44c7977916d tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:39:29.618721 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.wsgi [None req-695b1fc1-55f1-4e4f-849b-f44c7977916d tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] HTTP exception thrown: Instance 06ae865a-6ba5-4198-be6d-e6056e645411 could not be found. Jan 21 09:39:29.619309 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-695b1fc1-55f1-4e4f-849b-f44c7977916d tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Returning 404 to user: Instance 06ae865a-6ba5-4198-be6d-e6056e645411 could not be found. {{(pid=123386) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 21 09:39:29.620136 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-695b1fc1-55f1-4e4f-849b-f44c7977916d tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] 10.222.0.45 "GET /compute/v2.1/servers/06ae865a-6ba5-4198-be6d-e6056e645411" status: 404 len: 111 microversion: 2.1 time: 0.029830 Jan 21 09:39:29.620684 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 338/682] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:39:29 2022] GET /compute/v2.1/servers/06ae865a-6ba5-4198-be6d-e6056e645411 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 21 09:39:29.629341 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-61abf77e-80cc-45a1-828e-e3265f6be53f tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:39:29.629836 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-61abf77e-80cc-45a1-828e-e3265f6be53f tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] [instance: 4e67b25e-7e65-4975-bafa-fceafcd53647] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:39:29.635690 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-61abf77e-80cc-45a1-828e-e3265f6be53f tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:39:29.636132 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-61abf77e-80cc-45a1-828e-e3265f6be53f tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:39:29.636917 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-61abf77e-80cc-45a1-828e-e3265f6be53f tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:39:29.637378 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-61abf77e-80cc-45a1-828e-e3265f6be53f tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:39:29.666529 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-61abf77e-80cc-45a1-828e-e3265f6be53f tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] [instance: 4e67b25e-7e65-4975-bafa-fceafcd53647] Going to try to terminate instance {{(pid=123387) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 21 09:39:30.004119 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-61abf77e-80cc-45a1-828e-e3265f6be53f tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] 10.222.0.45 "DELETE /compute/v2.1/servers/4e67b25e-7e65-4975-bafa-fceafcd53647" status: 204 len: 0 microversion: 2.1 time: 0.378840 Jan 21 09:39:30.004993 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 345/683] 10.222.0.45 () {58 vars in 1238 bytes} [Fri Jan 21 09:39:29 2022] DELETE /compute/v2.1/servers/4e67b25e-7e65-4975-bafa-fceafcd53647 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 21 09:39:30.013128 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-8c55af63-c03b-4f74-8605-c6ac4d4631bc tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:39:30.013810 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-8c55af63-c03b-4f74-8605-c6ac4d4631bc tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] [instance: 4e67b25e-7e65-4975-bafa-fceafcd53647] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:39:30.020744 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-8c55af63-c03b-4f74-8605-c6ac4d4631bc tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:39:30.021217 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-8c55af63-c03b-4f74-8605-c6ac4d4631bc tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:39:30.022019 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-8c55af63-c03b-4f74-8605-c6ac4d4631bc tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:39:30.022461 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-8c55af63-c03b-4f74-8605-c6ac4d4631bc tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:39:30.160115 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-825d3c20-0dbd-4e76-a8ee-1cf308add50f tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:39:30.160822 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-825d3c20-0dbd-4e76-a8ee-1cf308add50f tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] [instance: 2733931f-f68e-4f48-85d2-5060a8f55eec] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:39:30.167173 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-825d3c20-0dbd-4e76-a8ee-1cf308add50f tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:39:30.167627 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-825d3c20-0dbd-4e76-a8ee-1cf308add50f tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:39:30.167887 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-8c55af63-c03b-4f74-8605-c6ac4d4631bc tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db87258db1424ce7a8399fdd05efe3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89d1b21ad8471a8a9a82adac2594c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:39:30.168420 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-825d3c20-0dbd-4e76-a8ee-1cf308add50f tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:39:30.169521 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-825d3c20-0dbd-4e76-a8ee-1cf308add50f tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:39:30.176129 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-8c55af63-c03b-4f74-8605-c6ac4d4631bc tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] 10.222.0.45 "GET /compute/v2.1/servers/4e67b25e-7e65-4975-bafa-fceafcd53647" status: 200 len: 1520 microversion: 2.1 time: 0.166739 Jan 21 09:39:30.177053 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 339/684] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:39:30 2022] GET /compute/v2.1/servers/4e67b25e-7e65-4975-bafa-fceafcd53647 => generated 1520 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:39:30.322331 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-825d3c20-0dbd-4e76-a8ee-1cf308add50f tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d53a7fa2cb5498aa916817b82dba77e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515ded26ca114fbf9c6e920362aec64c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:39:30.331168 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-825d3c20-0dbd-4e76-a8ee-1cf308add50f tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] 10.222.0.45 "GET /compute/v2.1/servers/2733931f-f68e-4f48-85d2-5060a8f55eec" status: 200 len: 1265 microversion: 2.1 time: 0.176268 Jan 21 09:39:30.331760 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 346/685] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:39:30 2022] GET /compute/v2.1/servers/2733931f-f68e-4f48-85d2-5060a8f55eec => generated 1265 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 09:39:30.468818 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-34a7d397-fc78-4a6a-8872-9ebb27c16e49 tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:39:30.469850 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-34a7d397-fc78-4a6a-8872-9ebb27c16e49 tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] [instance: 6104a6dc-afee-486a-a867-490dad16c883] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:39:30.476925 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-5f941e99-6880-47b1-90a9-98281f59ae33 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:39:30.477559 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-5f941e99-6880-47b1-90a9-98281f59ae33 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] [instance: 370b78d2-d154-4c93-b8ef-3723bd26c3d4] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:39:30.477740 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-34a7d397-fc78-4a6a-8872-9ebb27c16e49 tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:39:30.478182 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-34a7d397-fc78-4a6a-8872-9ebb27c16e49 tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:39:30.479135 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-34a7d397-fc78-4a6a-8872-9ebb27c16e49 tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:39:30.479400 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-34a7d397-fc78-4a6a-8872-9ebb27c16e49 tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:39:30.484255 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-5f941e99-6880-47b1-90a9-98281f59ae33 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:39:30.484706 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-5f941e99-6880-47b1-90a9-98281f59ae33 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:39:30.485540 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-5f941e99-6880-47b1-90a9-98281f59ae33 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:39:30.487037 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-5f941e99-6880-47b1-90a9-98281f59ae33 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:39:30.789588 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-34a7d397-fc78-4a6a-8872-9ebb27c16e49 tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498146f6a6814129b393e7084057bfd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db07feb3a43432999da539b6b85fb2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:39:30.797218 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-34a7d397-fc78-4a6a-8872-9ebb27c16e49 tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] 10.222.0.45 "GET /compute/v2.1/servers/6104a6dc-afee-486a-a867-490dad16c883" status: 200 len: 1514 microversion: 2.1 time: 0.333417 Jan 21 09:39:30.798903 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 340/686] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:39:30 2022] GET /compute/v2.1/servers/6104a6dc-afee-486a-a867-490dad16c883 => generated 1514 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:39:30.813386 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-5f941e99-6880-47b1-90a9-98281f59ae33 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7b2c14d9444d65ab7a874e749671bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3390729231b409e9a83376b428c1a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:39:30.822771 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-5f941e99-6880-47b1-90a9-98281f59ae33 tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] 10.222.0.45 "GET /compute/v2.1/servers/370b78d2-d154-4c93-b8ef-3723bd26c3d4" status: 200 len: 1514 microversion: 2.1 time: 0.349621 Jan 21 09:39:30.823357 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 347/687] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:39:30 2022] GET /compute/v2.1/servers/370b78d2-d154-4c93-b8ef-3723bd26c3d4 => generated 1514 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 09:39:31.107647 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [req-f2455b61-db6d-4ac9-8228-a712549fc086 req-0dac0550-a68e-4af4-a7a3-4bab9fb73620 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "370b78d2-d154-4c93-b8ef-3723bd26c3d4", "name": "network-vif-deleted", "tag": "af30d40e-e03c-4e1e-a789-41a34ac8bec6"}]} {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:39:31.111702 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 21 09:39:31.111702 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: warnings.warn(msg) Jan 21 09:39:31.122748 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [req-f2455b61-db6d-4ac9-8228-a712549fc086 req-0dac0550-a68e-4af4-a7a3-4bab9fb73620 service nova] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:39:31.123197 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [req-f2455b61-db6d-4ac9-8228-a712549fc086 req-0dac0550-a68e-4af4-a7a3-4bab9fb73620 service nova] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:39:31.136794 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.compute.server_external_events [req-f2455b61-db6d-4ac9-8228-a712549fc086 req-0dac0550-a68e-4af4-a7a3-4bab9fb73620 service nova] Creating event network-vif-deleted:af30d40e-e03c-4e1e-a789-41a34ac8bec6 for instance 370b78d2-d154-4c93-b8ef-3723bd26c3d4 on hv-cinder-80403 Jan 21 09:39:31.141920 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [req-f2455b61-db6d-4ac9-8228-a712549fc086 req-0dac0550-a68e-4af4-a7a3-4bab9fb73620 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041853 Jan 21 09:39:31.142781 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 341/688] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Jan 21 09:39:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 09:39:31.192986 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-510429cd-2877-4183-8e09-98c0094b6ba3 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:39:31.193709 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-510429cd-2877-4183-8e09-98c0094b6ba3 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] [instance: 4e67b25e-7e65-4975-bafa-fceafcd53647] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:39:31.199838 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-510429cd-2877-4183-8e09-98c0094b6ba3 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:39:31.200306 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-510429cd-2877-4183-8e09-98c0094b6ba3 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:39:31.201099 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-510429cd-2877-4183-8e09-98c0094b6ba3 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:39:31.201572 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-510429cd-2877-4183-8e09-98c0094b6ba3 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:39:31.343478 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-510429cd-2877-4183-8e09-98c0094b6ba3 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db87258db1424ce7a8399fdd05efe3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89d1b21ad8471a8a9a82adac2594c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:39:31.349058 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-d01890cd-a873-4f15-a1bc-be7d12d79643 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:39:31.349792 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-d01890cd-a873-4f15-a1bc-be7d12d79643 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] [instance: 2733931f-f68e-4f48-85d2-5060a8f55eec] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:39:31.353116 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-510429cd-2877-4183-8e09-98c0094b6ba3 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] 10.222.0.45 "GET /compute/v2.1/servers/4e67b25e-7e65-4975-bafa-fceafcd53647" status: 200 len: 1520 microversion: 2.1 time: 0.163887 Jan 21 09:39:31.353725 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 348/689] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:39:31 2022] GET /compute/v2.1/servers/4e67b25e-7e65-4975-bafa-fceafcd53647 => generated 1520 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:39:31.356305 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-d01890cd-a873-4f15-a1bc-be7d12d79643 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:39:31.356755 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-d01890cd-a873-4f15-a1bc-be7d12d79643 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:39:31.357717 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-d01890cd-a873-4f15-a1bc-be7d12d79643 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:39:31.358288 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-d01890cd-a873-4f15-a1bc-be7d12d79643 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:39:31.512599 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-d01890cd-a873-4f15-a1bc-be7d12d79643 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d53a7fa2cb5498aa916817b82dba77e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515ded26ca114fbf9c6e920362aec64c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:39:31.522538 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-d01890cd-a873-4f15-a1bc-be7d12d79643 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] 10.222.0.45 "GET /compute/v2.1/servers/2733931f-f68e-4f48-85d2-5060a8f55eec" status: 200 len: 1265 microversion: 2.1 time: 0.177997 Jan 21 09:39:31.523123 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 342/690] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:39:31 2022] GET /compute/v2.1/servers/2733931f-f68e-4f48-85d2-5060a8f55eec => generated 1265 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 09:39:31.816797 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-f8913cea-3bd2-437e-b6ea-3d1e76f7629d tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:39:31.817470 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-f8913cea-3bd2-437e-b6ea-3d1e76f7629d tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] [instance: 6104a6dc-afee-486a-a867-490dad16c883] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:39:31.827837 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-f8913cea-3bd2-437e-b6ea-3d1e76f7629d tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:39:31.828651 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-f8913cea-3bd2-437e-b6ea-3d1e76f7629d tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:39:31.829530 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-f8913cea-3bd2-437e-b6ea-3d1e76f7629d tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:39:31.829969 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-f8913cea-3bd2-437e-b6ea-3d1e76f7629d tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:39:31.839949 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-897d39be-ab43-463b-aad6-8c539c3d4cfc tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:39:31.840815 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-897d39be-ab43-463b-aad6-8c539c3d4cfc tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] [instance: 370b78d2-d154-4c93-b8ef-3723bd26c3d4] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:39:31.848080 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-897d39be-ab43-463b-aad6-8c539c3d4cfc tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:39:31.848626 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-897d39be-ab43-463b-aad6-8c539c3d4cfc tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:39:31.849918 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-897d39be-ab43-463b-aad6-8c539c3d4cfc tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:39:31.849918 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-897d39be-ab43-463b-aad6-8c539c3d4cfc tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:39:31.884436 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-897d39be-ab43-463b-aad6-8c539c3d4cfc tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:39:31.884879 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-897d39be-ab43-463b-aad6-8c539c3d4cfc tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:39:31.885353 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.objects.instance [None req-897d39be-ab43-463b-aad6-8c539c3d4cfc tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lazy-loading 'fault' on Instance uuid 370b78d2-d154-4c93-b8ef-3723bd26c3d4 {{(pid=123386) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 21 09:39:31.961374 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-897d39be-ab43-463b-aad6-8c539c3d4cfc tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7b2c14d9444d65ab7a874e749671bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3390729231b409e9a83376b428c1a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:39:31.972732 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-897d39be-ab43-463b-aad6-8c539c3d4cfc tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] 10.222.0.45 "GET /compute/v2.1/servers/370b78d2-d154-4c93-b8ef-3723bd26c3d4" status: 200 len: 1307 microversion: 2.1 time: 0.136374 Jan 21 09:39:31.973347 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 343/691] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:39:31 2022] GET /compute/v2.1/servers/370b78d2-d154-4c93-b8ef-3723bd26c3d4 => generated 1307 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:39:32.077057 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-f8913cea-3bd2-437e-b6ea-3d1e76f7629d tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498146f6a6814129b393e7084057bfd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db07feb3a43432999da539b6b85fb2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:39:32.085727 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-f8913cea-3bd2-437e-b6ea-3d1e76f7629d tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] 10.222.0.45 "GET /compute/v2.1/servers/6104a6dc-afee-486a-a867-490dad16c883" status: 200 len: 1514 microversion: 2.1 time: 0.273573 Jan 21 09:39:32.088236 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 349/692] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:39:31 2022] GET /compute/v2.1/servers/6104a6dc-afee-486a-a867-490dad16c883 => generated 1514 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:39:32.370621 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-e7b38c2b-823b-4a1b-9be4-d7ce5f37ab5e tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:39:32.371233 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-e7b38c2b-823b-4a1b-9be4-d7ce5f37ab5e tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] [instance: 4e67b25e-7e65-4975-bafa-fceafcd53647] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:39:32.378021 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-e7b38c2b-823b-4a1b-9be4-d7ce5f37ab5e tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:39:32.378543 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-e7b38c2b-823b-4a1b-9be4-d7ce5f37ab5e tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:39:32.379456 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-e7b38c2b-823b-4a1b-9be4-d7ce5f37ab5e tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:39:32.379906 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-e7b38c2b-823b-4a1b-9be4-d7ce5f37ab5e tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:39:32.539958 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-76678242-6eac-46dc-9eab-96a043d0b4fb tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:39:32.540979 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-76678242-6eac-46dc-9eab-96a043d0b4fb tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] [instance: 2733931f-f68e-4f48-85d2-5060a8f55eec] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:39:32.547848 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-76678242-6eac-46dc-9eab-96a043d0b4fb tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:39:32.548311 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-76678242-6eac-46dc-9eab-96a043d0b4fb tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:39:32.549087 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-76678242-6eac-46dc-9eab-96a043d0b4fb tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:39:32.549613 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-76678242-6eac-46dc-9eab-96a043d0b4fb tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:39:32.582543 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-e7b38c2b-823b-4a1b-9be4-d7ce5f37ab5e tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db87258db1424ce7a8399fdd05efe3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89d1b21ad8471a8a9a82adac2594c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:39:32.595234 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-e7b38c2b-823b-4a1b-9be4-d7ce5f37ab5e tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] 10.222.0.45 "GET /compute/v2.1/servers/4e67b25e-7e65-4975-bafa-fceafcd53647" status: 200 len: 1520 microversion: 2.1 time: 0.228148 Jan 21 09:39:32.595828 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 344/693] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:39:32 2022] GET /compute/v2.1/servers/4e67b25e-7e65-4975-bafa-fceafcd53647 => generated 1520 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 09:39:32.689749 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-76678242-6eac-46dc-9eab-96a043d0b4fb tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d53a7fa2cb5498aa916817b82dba77e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515ded26ca114fbf9c6e920362aec64c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:39:32.697786 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-76678242-6eac-46dc-9eab-96a043d0b4fb tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] 10.222.0.45 "GET /compute/v2.1/servers/2733931f-f68e-4f48-85d2-5060a8f55eec" status: 200 len: 1265 microversion: 2.1 time: 0.161684 Jan 21 09:39:32.698356 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 350/694] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:39:32 2022] GET /compute/v2.1/servers/2733931f-f68e-4f48-85d2-5060a8f55eec => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 09:39:32.989816 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-4eb5b5fc-0468-49b1-93fc-6a2ef740c6bd tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:39:32.990423 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-4eb5b5fc-0468-49b1-93fc-6a2ef740c6bd tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] [instance: 370b78d2-d154-4c93-b8ef-3723bd26c3d4] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:39:32.996804 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-4eb5b5fc-0468-49b1-93fc-6a2ef740c6bd tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:39:32.997286 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-4eb5b5fc-0468-49b1-93fc-6a2ef740c6bd tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:39:32.998104 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-4eb5b5fc-0468-49b1-93fc-6a2ef740c6bd tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:39:32.998531 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-4eb5b5fc-0468-49b1-93fc-6a2ef740c6bd tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:39:33.013732 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.wsgi [None req-4eb5b5fc-0468-49b1-93fc-6a2ef740c6bd tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] HTTP exception thrown: Instance 370b78d2-d154-4c93-b8ef-3723bd26c3d4 could not be found. Jan 21 09:39:33.014333 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-4eb5b5fc-0468-49b1-93fc-6a2ef740c6bd tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] Returning 404 to user: Instance 370b78d2-d154-4c93-b8ef-3723bd26c3d4 could not be found. {{(pid=123386) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 21 09:39:33.015241 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-4eb5b5fc-0468-49b1-93fc-6a2ef740c6bd tempest-AttachVolumeNegativeTest-2130446618 tempest-AttachVolumeNegativeTest-2130446618-project] 10.222.0.45 "GET /compute/v2.1/servers/370b78d2-d154-4c93-b8ef-3723bd26c3d4" status: 404 len: 111 microversion: 2.1 time: 0.030068 Jan 21 09:39:33.016176 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 345/695] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:39:32 2022] GET /compute/v2.1/servers/370b78d2-d154-4c93-b8ef-3723bd26c3d4 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 21 09:39:33.106938 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-0cae24a1-1973-491e-a495-19ab2b58dc62 tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:39:33.108261 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-0cae24a1-1973-491e-a495-19ab2b58dc62 tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] [instance: 6104a6dc-afee-486a-a867-490dad16c883] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:39:33.119788 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-0cae24a1-1973-491e-a495-19ab2b58dc62 tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:39:33.120491 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-0cae24a1-1973-491e-a495-19ab2b58dc62 tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:39:33.121683 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-0cae24a1-1973-491e-a495-19ab2b58dc62 tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:39:33.122253 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-0cae24a1-1973-491e-a495-19ab2b58dc62 tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:39:33.157380 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [req-326d01ef-9b7a-4dcb-bc93-c71c82cd331e req-18922a76-106f-4e38-bd00-d858b7f8a09d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6104a6dc-afee-486a-a867-490dad16c883", "name": "network-vif-deleted", "tag": "ac7a3142-12ec-4772-8b8e-f317cdd18a45"}]} {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:39:33.159013 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 21 09:39:33.159013 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: warnings.warn(msg) Jan 21 09:39:33.163110 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-0cae24a1-1973-491e-a495-19ab2b58dc62 tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:39:33.163657 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-0cae24a1-1973-491e-a495-19ab2b58dc62 tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:39:33.164185 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.objects.instance [None req-0cae24a1-1973-491e-a495-19ab2b58dc62 tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Lazy-loading 'fault' on Instance uuid 6104a6dc-afee-486a-a867-490dad16c883 {{(pid=123387) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 21 09:39:33.167292 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [req-326d01ef-9b7a-4dcb-bc93-c71c82cd331e req-18922a76-106f-4e38-bd00-d858b7f8a09d service nova] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:39:33.177170 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [req-326d01ef-9b7a-4dcb-bc93-c71c82cd331e req-18922a76-106f-4e38-bd00-d858b7f8a09d service nova] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:39:33.181167 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.compute.server_external_events [req-326d01ef-9b7a-4dcb-bc93-c71c82cd331e req-18922a76-106f-4e38-bd00-d858b7f8a09d service nova] Creating event network-vif-deleted:ac7a3142-12ec-4772-8b8e-f317cdd18a45 for instance 6104a6dc-afee-486a-a867-490dad16c883 on hv-cinder-80403 Jan 21 09:39:33.186258 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [req-326d01ef-9b7a-4dcb-bc93-c71c82cd331e req-18922a76-106f-4e38-bd00-d858b7f8a09d service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032341 Jan 21 09:39:33.186982 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 346/696] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Jan 21 09:39:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 21 09:39:33.211689 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-0cae24a1-1973-491e-a495-19ab2b58dc62 tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498146f6a6814129b393e7084057bfd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db07feb3a43432999da539b6b85fb2a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:39:33.219327 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-0cae24a1-1973-491e-a495-19ab2b58dc62 tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] 10.222.0.45 "GET /compute/v2.1/servers/6104a6dc-afee-486a-a867-490dad16c883" status: 200 len: 1309 microversion: 2.1 time: 0.117882 Jan 21 09:39:33.229607 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 351/697] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:39:33 2022] GET /compute/v2.1/servers/6104a6dc-afee-486a-a867-490dad16c883 => generated 1309 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:39:33.613882 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-8e9fc2b7-6a8d-4780-a746-6b2770b61967 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:39:33.614580 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-8e9fc2b7-6a8d-4780-a746-6b2770b61967 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] [instance: 4e67b25e-7e65-4975-bafa-fceafcd53647] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:39:33.620779 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-8e9fc2b7-6a8d-4780-a746-6b2770b61967 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:39:33.621259 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-8e9fc2b7-6a8d-4780-a746-6b2770b61967 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:39:33.622070 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-8e9fc2b7-6a8d-4780-a746-6b2770b61967 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:39:33.622507 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-8e9fc2b7-6a8d-4780-a746-6b2770b61967 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:39:33.720021 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-b5bdf264-3a65-4379-b6a1-597d11976b38 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:39:33.720021 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-b5bdf264-3a65-4379-b6a1-597d11976b38 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] [instance: 2733931f-f68e-4f48-85d2-5060a8f55eec] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:39:33.725298 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-b5bdf264-3a65-4379-b6a1-597d11976b38 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:39:33.725959 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-b5bdf264-3a65-4379-b6a1-597d11976b38 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:39:33.726688 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-b5bdf264-3a65-4379-b6a1-597d11976b38 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:39:33.727125 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-b5bdf264-3a65-4379-b6a1-597d11976b38 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:39:33.778892 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-8e9fc2b7-6a8d-4780-a746-6b2770b61967 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db87258db1424ce7a8399fdd05efe3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89d1b21ad8471a8a9a82adac2594c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:39:33.794434 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-8e9fc2b7-6a8d-4780-a746-6b2770b61967 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] 10.222.0.45 "GET /compute/v2.1/servers/4e67b25e-7e65-4975-bafa-fceafcd53647" status: 200 len: 1520 microversion: 2.1 time: 0.184819 Jan 21 09:39:33.795280 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 347/698] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:39:33 2022] GET /compute/v2.1/servers/4e67b25e-7e65-4975-bafa-fceafcd53647 => generated 1520 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:39:33.892109 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-b5bdf264-3a65-4379-b6a1-597d11976b38 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d53a7fa2cb5498aa916817b82dba77e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515ded26ca114fbf9c6e920362aec64c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:39:33.900276 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-b5bdf264-3a65-4379-b6a1-597d11976b38 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] 10.222.0.45 "GET /compute/v2.1/servers/2733931f-f68e-4f48-85d2-5060a8f55eec" status: 200 len: 1265 microversion: 2.1 time: 0.188417 Jan 21 09:39:33.900857 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 352/699] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:39:33 2022] GET /compute/v2.1/servers/2733931f-f68e-4f48-85d2-5060a8f55eec => generated 1265 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:39:34.239210 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-5e809925-3f6f-430f-8ab2-3eb4f9814cde tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:39:34.239971 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-5e809925-3f6f-430f-8ab2-3eb4f9814cde tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] [instance: 6104a6dc-afee-486a-a867-490dad16c883] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:39:34.246199 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-5e809925-3f6f-430f-8ab2-3eb4f9814cde tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:39:34.246654 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-5e809925-3f6f-430f-8ab2-3eb4f9814cde tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:39:34.247477 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-5e809925-3f6f-430f-8ab2-3eb4f9814cde tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:39:34.248093 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-5e809925-3f6f-430f-8ab2-3eb4f9814cde tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:39:34.262430 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.wsgi [None req-5e809925-3f6f-430f-8ab2-3eb4f9814cde tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] HTTP exception thrown: Instance 6104a6dc-afee-486a-a867-490dad16c883 could not be found. Jan 21 09:39:34.263025 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-5e809925-3f6f-430f-8ab2-3eb4f9814cde tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] Returning 404 to user: Instance 6104a6dc-afee-486a-a867-490dad16c883 could not be found. {{(pid=123386) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 21 09:39:34.263867 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-5e809925-3f6f-430f-8ab2-3eb4f9814cde tempest-VolumesSnapshotTestJSON-1583482103 tempest-VolumesSnapshotTestJSON-1583482103-project] 10.222.0.45 "GET /compute/v2.1/servers/6104a6dc-afee-486a-a867-490dad16c883" status: 404 len: 111 microversion: 2.1 time: 0.029705 Jan 21 09:39:34.264428 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 348/700] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:39:34 2022] GET /compute/v2.1/servers/6104a6dc-afee-486a-a867-490dad16c883 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 21 09:39:34.811850 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-b4173e82-b788-4f6a-8f9b-344f2a4cc450 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:39:34.813022 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-b4173e82-b788-4f6a-8f9b-344f2a4cc450 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] [instance: 4e67b25e-7e65-4975-bafa-fceafcd53647] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:39:34.820887 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-b4173e82-b788-4f6a-8f9b-344f2a4cc450 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:39:34.820887 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-b4173e82-b788-4f6a-8f9b-344f2a4cc450 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:39:34.821943 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-b4173e82-b788-4f6a-8f9b-344f2a4cc450 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:39:34.822373 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-b4173e82-b788-4f6a-8f9b-344f2a4cc450 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:39:34.917690 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-806e4828-1341-4ee3-a675-ee293f90d66b tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:39:34.919213 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-806e4828-1341-4ee3-a675-ee293f90d66b tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] [instance: 2733931f-f68e-4f48-85d2-5060a8f55eec] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:39:34.932004 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-806e4828-1341-4ee3-a675-ee293f90d66b tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:39:34.932004 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-806e4828-1341-4ee3-a675-ee293f90d66b tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:39:34.932004 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-806e4828-1341-4ee3-a675-ee293f90d66b tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:39:34.932004 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-806e4828-1341-4ee3-a675-ee293f90d66b tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:39:35.021430 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-b4173e82-b788-4f6a-8f9b-344f2a4cc450 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db87258db1424ce7a8399fdd05efe3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89d1b21ad8471a8a9a82adac2594c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:39:35.028925 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-b4173e82-b788-4f6a-8f9b-344f2a4cc450 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] 10.222.0.45 "GET /compute/v2.1/servers/4e67b25e-7e65-4975-bafa-fceafcd53647" status: 200 len: 1520 microversion: 2.1 time: 0.220553 Jan 21 09:39:35.029541 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 353/701] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:39:34 2022] GET /compute/v2.1/servers/4e67b25e-7e65-4975-bafa-fceafcd53647 => generated 1520 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:39:35.093633 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-806e4828-1341-4ee3-a675-ee293f90d66b tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d53a7fa2cb5498aa916817b82dba77e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515ded26ca114fbf9c6e920362aec64c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:39:35.107478 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-806e4828-1341-4ee3-a675-ee293f90d66b tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] 10.222.0.45 "GET /compute/v2.1/servers/2733931f-f68e-4f48-85d2-5060a8f55eec" status: 200 len: 1265 microversion: 2.1 time: 0.193006 Jan 21 09:39:35.108629 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 349/702] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:39:34 2022] GET /compute/v2.1/servers/2733931f-f68e-4f48-85d2-5060a8f55eec => generated 1265 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 09:39:35.782992 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-0a695f81-447c-4287-b760-5906e219415e tempest-VolumesSnapshotsTestJSON-2008636442 tempest-VolumesSnapshotsTestJSON-2008636442-project] Action: 'create', calling method: .version_select at 0x7fb6c2d66d30>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-58575165"}} {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:39:36.054424 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-25ed3db9-7463-48bf-9424-ebf59927266a tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:39:36.055036 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-25ed3db9-7463-48bf-9424-ebf59927266a tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] [instance: 4e67b25e-7e65-4975-bafa-fceafcd53647] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:39:36.062375 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-25ed3db9-7463-48bf-9424-ebf59927266a tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:39:36.062822 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-25ed3db9-7463-48bf-9424-ebf59927266a tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:39:36.063632 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-25ed3db9-7463-48bf-9424-ebf59927266a tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:39:36.064062 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-25ed3db9-7463-48bf-9424-ebf59927266a tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:39:36.213492 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-25ed3db9-7463-48bf-9424-ebf59927266a tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db87258db1424ce7a8399fdd05efe3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89d1b21ad8471a8a9a82adac2594c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:39:36.221162 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-25ed3db9-7463-48bf-9424-ebf59927266a tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] 10.222.0.45 "GET /compute/v2.1/servers/4e67b25e-7e65-4975-bafa-fceafcd53647" status: 200 len: 1520 microversion: 2.1 time: 0.171547 Jan 21 09:39:36.222357 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 350/703] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:39:36 2022] GET /compute/v2.1/servers/4e67b25e-7e65-4975-bafa-fceafcd53647 => generated 1520 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:39:36.226748 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-8666837f-d1bd-4db3-a58d-504dff29e903 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:39:36.228604 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-8666837f-d1bd-4db3-a58d-504dff29e903 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] [instance: 2733931f-f68e-4f48-85d2-5060a8f55eec] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:39:36.233224 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-8666837f-d1bd-4db3-a58d-504dff29e903 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:39:36.233687 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-8666837f-d1bd-4db3-a58d-504dff29e903 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:39:36.234476 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-8666837f-d1bd-4db3-a58d-504dff29e903 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:39:36.235089 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-8666837f-d1bd-4db3-a58d-504dff29e903 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:39:36.393065 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-8666837f-d1bd-4db3-a58d-504dff29e903 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d53a7fa2cb5498aa916817b82dba77e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515ded26ca114fbf9c6e920362aec64c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:39:36.403457 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-8666837f-d1bd-4db3-a58d-504dff29e903 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] 10.222.0.45 "GET /compute/v2.1/servers/2733931f-f68e-4f48-85d2-5060a8f55eec" status: 200 len: 1265 microversion: 2.1 time: 0.180024 Jan 21 09:39:36.404195 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 351/704] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:39:36 2022] GET /compute/v2.1/servers/2733931f-f68e-4f48-85d2-5060a8f55eec => generated 1265 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:39:36.642747 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-0a695f81-447c-4287-b760-5906e219415e tempest-VolumesSnapshotsTestJSON-2008636442 tempest-VolumesSnapshotsTestJSON-2008636442-project] 10.222.0.45 "POST /compute/v2.1/os-volumes" status: 200 len: 343 microversion: 2.1 time: 0.988320 Jan 21 09:39:36.644032 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 354/705] 10.222.0.45 () {60 vars in 1154 bytes} [Fri Jan 21 09:39:35 2022] POST /compute/v2.1/os-volumes => generated 343 bytes in 990 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jan 21 09:39:36.662017 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-cdce08c2-ecd8-4d5c-aa28-dba4b4ceeea7 tempest-VolumesSnapshotsTestJSON-2008636442 tempest-VolumesSnapshotsTestJSON-2008636442-project] Calling method '.version_select at 0x7fb6c2c80dc0>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:39:36.711004 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-cdce08c2-ecd8-4d5c-aa28-dba4b4ceeea7 tempest-VolumesSnapshotsTestJSON-2008636442 tempest-VolumesSnapshotsTestJSON-2008636442-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/8b6ebcb6-26d7-4c5d-baaf-aa32c326a9ca" status: 200 len: 343 microversion: 2.1 time: 0.055213 Jan 21 09:39:36.711746 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 352/706] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Jan 21 09:39:36 2022] GET /compute/v2.1/os-volumes/8b6ebcb6-26d7-4c5d-baaf-aa32c326a9ca => generated 343 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 09:39:37.240890 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-c9c4e37f-89a8-49f7-82f6-e4cd3c547233 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:39:37.241528 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-c9c4e37f-89a8-49f7-82f6-e4cd3c547233 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] [instance: 4e67b25e-7e65-4975-bafa-fceafcd53647] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:39:37.248664 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-c9c4e37f-89a8-49f7-82f6-e4cd3c547233 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:39:37.252024 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-c9c4e37f-89a8-49f7-82f6-e4cd3c547233 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:39:37.252024 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-c9c4e37f-89a8-49f7-82f6-e4cd3c547233 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:39:37.252024 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-c9c4e37f-89a8-49f7-82f6-e4cd3c547233 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:39:37.385961 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-c9c4e37f-89a8-49f7-82f6-e4cd3c547233 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db87258db1424ce7a8399fdd05efe3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89d1b21ad8471a8a9a82adac2594c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:39:37.394651 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-c9c4e37f-89a8-49f7-82f6-e4cd3c547233 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] 10.222.0.45 "GET /compute/v2.1/servers/4e67b25e-7e65-4975-bafa-fceafcd53647" status: 200 len: 1520 microversion: 2.1 time: 0.157877 Jan 21 09:39:37.395236 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 355/707] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:39:37 2022] GET /compute/v2.1/servers/4e67b25e-7e65-4975-bafa-fceafcd53647 => generated 1520 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:39:37.420551 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-4860b0bc-4fe6-4f49-a29d-56c2c57bba38 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:39:37.421152 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-4860b0bc-4fe6-4f49-a29d-56c2c57bba38 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] [instance: 2733931f-f68e-4f48-85d2-5060a8f55eec] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:39:37.429045 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-4860b0bc-4fe6-4f49-a29d-56c2c57bba38 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:39:37.430309 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-4860b0bc-4fe6-4f49-a29d-56c2c57bba38 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:39:37.431136 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-4860b0bc-4fe6-4f49-a29d-56c2c57bba38 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:39:37.431571 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-4860b0bc-4fe6-4f49-a29d-56c2c57bba38 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:39:37.572955 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-4860b0bc-4fe6-4f49-a29d-56c2c57bba38 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d53a7fa2cb5498aa916817b82dba77e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515ded26ca114fbf9c6e920362aec64c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:39:37.581941 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-4860b0bc-4fe6-4f49-a29d-56c2c57bba38 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] 10.222.0.45 "GET /compute/v2.1/servers/2733931f-f68e-4f48-85d2-5060a8f55eec" status: 200 len: 1265 microversion: 2.1 time: 0.164419 Jan 21 09:39:37.582623 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 353/708] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:39:37 2022] GET /compute/v2.1/servers/2733931f-f68e-4f48-85d2-5060a8f55eec => generated 1265 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:39:37.724792 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-45d2f623-8cbf-4e35-bd91-1a3c35202633 tempest-VolumesSnapshotsTestJSON-2008636442 tempest-VolumesSnapshotsTestJSON-2008636442-project] Calling method '.version_select at 0x7fb6c2acd700>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:39:37.773931 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-45d2f623-8cbf-4e35-bd91-1a3c35202633 tempest-VolumesSnapshotsTestJSON-2008636442 tempest-VolumesSnapshotsTestJSON-2008636442-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/8b6ebcb6-26d7-4c5d-baaf-aa32c326a9ca" status: 200 len: 343 microversion: 2.1 time: 0.053400 Jan 21 09:39:37.774506 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 356/709] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Jan 21 09:39:37 2022] GET /compute/v2.1/os-volumes/8b6ebcb6-26d7-4c5d-baaf-aa32c326a9ca => generated 343 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 09:39:38.411338 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-f0498ab1-36fa-4d0c-be61-f449fff56eba tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:39:38.411967 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-f0498ab1-36fa-4d0c-be61-f449fff56eba tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] [instance: 4e67b25e-7e65-4975-bafa-fceafcd53647] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:39:38.419016 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-f0498ab1-36fa-4d0c-be61-f449fff56eba tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:39:38.419474 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-f0498ab1-36fa-4d0c-be61-f449fff56eba tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:39:38.420273 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-f0498ab1-36fa-4d0c-be61-f449fff56eba tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:39:38.420718 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-f0498ab1-36fa-4d0c-be61-f449fff56eba tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:39:38.556090 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-f0498ab1-36fa-4d0c-be61-f449fff56eba tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db87258db1424ce7a8399fdd05efe3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89d1b21ad8471a8a9a82adac2594c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:39:38.563679 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-f0498ab1-36fa-4d0c-be61-f449fff56eba tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] 10.222.0.45 "GET /compute/v2.1/servers/4e67b25e-7e65-4975-bafa-fceafcd53647" status: 200 len: 1520 microversion: 2.1 time: 0.155956 Jan 21 09:39:38.564256 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 354/710] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:39:38 2022] GET /compute/v2.1/servers/4e67b25e-7e65-4975-bafa-fceafcd53647 => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:39:38.603708 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-3f33776c-eef1-4fd8-a55c-a887de259fa7 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:39:38.604397 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-3f33776c-eef1-4fd8-a55c-a887de259fa7 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] [instance: 2733931f-f68e-4f48-85d2-5060a8f55eec] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:39:38.611158 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-3f33776c-eef1-4fd8-a55c-a887de259fa7 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:39:38.611607 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-3f33776c-eef1-4fd8-a55c-a887de259fa7 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:39:38.613220 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-3f33776c-eef1-4fd8-a55c-a887de259fa7 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:39:38.613673 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-3f33776c-eef1-4fd8-a55c-a887de259fa7 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:39:38.769072 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-3f33776c-eef1-4fd8-a55c-a887de259fa7 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d53a7fa2cb5498aa916817b82dba77e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515ded26ca114fbf9c6e920362aec64c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:39:38.776781 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-3f33776c-eef1-4fd8-a55c-a887de259fa7 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] 10.222.0.45 "GET /compute/v2.1/servers/2733931f-f68e-4f48-85d2-5060a8f55eec" status: 200 len: 1265 microversion: 2.1 time: 0.177272 Jan 21 09:39:38.777406 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 357/711] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:39:38 2022] GET /compute/v2.1/servers/2733931f-f68e-4f48-85d2-5060a8f55eec => generated 1265 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:39:38.786843 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-98a9a229-d406-4aa8-b39d-e7486c5a3366 tempest-VolumesSnapshotsTestJSON-2008636442 tempest-VolumesSnapshotsTestJSON-2008636442-project] Calling method '.version_select at 0x7fb6c80c0550>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:39:38.838206 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-98a9a229-d406-4aa8-b39d-e7486c5a3366 tempest-VolumesSnapshotsTestJSON-2008636442 tempest-VolumesSnapshotsTestJSON-2008636442-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/8b6ebcb6-26d7-4c5d-baaf-aa32c326a9ca" status: 200 len: 343 microversion: 2.1 time: 0.051964 Jan 21 09:39:38.838206 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 355/712] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Jan 21 09:39:38 2022] GET /compute/v2.1/os-volumes/8b6ebcb6-26d7-4c5d-baaf-aa32c326a9ca => generated 343 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 09:39:38.948829 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [req-787d9020-fec0-488e-bb87-de47dea8e818 req-b8a3f955-4aed-478b-9e83-42cecdcb5cb2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2733931f-f68e-4f48-85d2-5060a8f55eec", "name": "network-vif-plugged", "status": "completed", "tag": "fdcd5489-3e9c-4a62-8bc8-26a5c193cc04"}]} {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:39:38.952750 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 21 09:39:38.952750 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: warnings.warn(msg) Jan 21 09:39:38.957927 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [req-787d9020-fec0-488e-bb87-de47dea8e818 req-b8a3f955-4aed-478b-9e83-42cecdcb5cb2 service nova] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:39:38.958367 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [req-787d9020-fec0-488e-bb87-de47dea8e818 req-b8a3f955-4aed-478b-9e83-42cecdcb5cb2 service nova] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:39:38.969115 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.compute.server_external_events [req-787d9020-fec0-488e-bb87-de47dea8e818 req-b8a3f955-4aed-478b-9e83-42cecdcb5cb2 service nova] Creating event network-vif-plugged:fdcd5489-3e9c-4a62-8bc8-26a5c193cc04 for instance 2733931f-f68e-4f48-85d2-5060a8f55eec on hv-cinder-80403 Jan 21 09:39:38.974381 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [req-787d9020-fec0-488e-bb87-de47dea8e818 req-b8a3f955-4aed-478b-9e83-42cecdcb5cb2 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029177 Jan 21 09:39:38.974992 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 358/713] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Jan 21 09:39:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 09:39:39.582252 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-113bb1e7-3b17-4ede-a35d-026f89a2bfcb tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:39:39.582832 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-113bb1e7-3b17-4ede-a35d-026f89a2bfcb tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] [instance: 4e67b25e-7e65-4975-bafa-fceafcd53647] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:39:39.588855 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-113bb1e7-3b17-4ede-a35d-026f89a2bfcb tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:39:39.589327 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-113bb1e7-3b17-4ede-a35d-026f89a2bfcb tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:39:39.590105 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-113bb1e7-3b17-4ede-a35d-026f89a2bfcb tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:39:39.590537 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-113bb1e7-3b17-4ede-a35d-026f89a2bfcb tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:39:39.740195 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-113bb1e7-3b17-4ede-a35d-026f89a2bfcb tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db87258db1424ce7a8399fdd05efe3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89d1b21ad8471a8a9a82adac2594c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:39:39.748048 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-113bb1e7-3b17-4ede-a35d-026f89a2bfcb tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] 10.222.0.45 "GET /compute/v2.1/servers/4e67b25e-7e65-4975-bafa-fceafcd53647" status: 200 len: 1520 microversion: 2.1 time: 0.170585 Jan 21 09:39:39.748621 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 356/714] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:39:39 2022] GET /compute/v2.1/servers/4e67b25e-7e65-4975-bafa-fceafcd53647 => generated 1520 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:39:39.795242 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-7ae4e04d-42c8-4ca2-8798-8d77b8476010 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:39:39.796069 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-7ae4e04d-42c8-4ca2-8798-8d77b8476010 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] [instance: 2733931f-f68e-4f48-85d2-5060a8f55eec] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:39:39.802695 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-7ae4e04d-42c8-4ca2-8798-8d77b8476010 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:39:39.810034 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-7ae4e04d-42c8-4ca2-8798-8d77b8476010 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:39:39.810034 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-7ae4e04d-42c8-4ca2-8798-8d77b8476010 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:39:39.810034 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-7ae4e04d-42c8-4ca2-8798-8d77b8476010 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:39:39.847817 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-1a4ea37d-485d-41c5-a384-5e137294040d tempest-VolumesSnapshotsTestJSON-2008636442 tempest-VolumesSnapshotsTestJSON-2008636442-project] Calling method '.version_select at 0x7fb6c2cac700>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:39:39.896314 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-1a4ea37d-485d-41c5-a384-5e137294040d tempest-VolumesSnapshotsTestJSON-2008636442 tempest-VolumesSnapshotsTestJSON-2008636442-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/8b6ebcb6-26d7-4c5d-baaf-aa32c326a9ca" status: 200 len: 343 microversion: 2.1 time: 0.052715 Jan 21 09:39:39.896886 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 357/715] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Jan 21 09:39:39 2022] GET /compute/v2.1/os-volumes/8b6ebcb6-26d7-4c5d-baaf-aa32c326a9ca => generated 343 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 21 09:39:39.961089 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-7ae4e04d-42c8-4ca2-8798-8d77b8476010 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d53a7fa2cb5498aa916817b82dba77e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515ded26ca114fbf9c6e920362aec64c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:39:39.968603 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-7ae4e04d-42c8-4ca2-8798-8d77b8476010 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] 10.222.0.45 "GET /compute/v2.1/servers/2733931f-f68e-4f48-85d2-5060a8f55eec" status: 200 len: 1265 microversion: 2.1 time: 0.177495 Jan 21 09:39:39.969309 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 359/716] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:39:39 2022] GET /compute/v2.1/servers/2733931f-f68e-4f48-85d2-5060a8f55eec => generated 1265 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:39:40.766734 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-dfd36515-3b46-4265-90d5-da4ba0a7faf4 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:39:40.767620 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-dfd36515-3b46-4265-90d5-da4ba0a7faf4 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] [instance: 4e67b25e-7e65-4975-bafa-fceafcd53647] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:39:40.776888 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-dfd36515-3b46-4265-90d5-da4ba0a7faf4 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:39:40.777414 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-dfd36515-3b46-4265-90d5-da4ba0a7faf4 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:39:40.778221 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-dfd36515-3b46-4265-90d5-da4ba0a7faf4 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:39:40.778660 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-dfd36515-3b46-4265-90d5-da4ba0a7faf4 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:39:40.908467 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-e624a939-040a-4e1f-bbda-841281b0e143 tempest-VolumesSnapshotsTestJSON-2008636442 tempest-VolumesSnapshotsTestJSON-2008636442-project] Calling method '.version_select at 0x7fb6c2b67d30>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:39:40.914187 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-dfd36515-3b46-4265-90d5-da4ba0a7faf4 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db87258db1424ce7a8399fdd05efe3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89d1b21ad8471a8a9a82adac2594c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:39:40.928875 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-dfd36515-3b46-4265-90d5-da4ba0a7faf4 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] 10.222.0.45 "GET /compute/v2.1/servers/4e67b25e-7e65-4975-bafa-fceafcd53647" status: 200 len: 1478 microversion: 2.1 time: 0.166400 Jan 21 09:39:40.929879 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 358/717] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:39:40 2022] GET /compute/v2.1/servers/4e67b25e-7e65-4975-bafa-fceafcd53647 => generated 1478 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:39:40.937999 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [req-fa027f05-2f93-43d9-8ecb-17fca9c951cf req-8766c5b2-562e-4f9b-99f7-2878e8c07017 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e67b25e-7e65-4975-bafa-fceafcd53647", "name": "network-vif-deleted", "tag": "9eccc2a4-ddb6-4675-9f12-63953114fa21"}]} {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:39:40.942183 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 21 09:39:40.942183 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: warnings.warn(msg) Jan 21 09:39:40.953593 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [req-fa027f05-2f93-43d9-8ecb-17fca9c951cf req-8766c5b2-562e-4f9b-99f7-2878e8c07017 service nova] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:39:40.954296 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [req-fa027f05-2f93-43d9-8ecb-17fca9c951cf req-8766c5b2-562e-4f9b-99f7-2878e8c07017 service nova] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:39:40.977607 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.compute.server_external_events [req-fa027f05-2f93-43d9-8ecb-17fca9c951cf req-8766c5b2-562e-4f9b-99f7-2878e8c07017 service nova] Creating event network-vif-deleted:9eccc2a4-ddb6-4675-9f12-63953114fa21 for instance 4e67b25e-7e65-4975-bafa-fceafcd53647 on hv-cinder-80403 Jan 21 09:39:40.988396 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [req-fa027f05-2f93-43d9-8ecb-17fca9c951cf req-8766c5b2-562e-4f9b-99f7-2878e8c07017 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056554 Jan 21 09:39:40.989427 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 359/718] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Jan 21 09:39:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 09:39:40.995916 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-3c992a74-6326-42a2-836b-3a3af1ea43cc tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:39:40.996847 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-3c992a74-6326-42a2-836b-3a3af1ea43cc tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] [instance: 2733931f-f68e-4f48-85d2-5060a8f55eec] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:39:40.998949 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-e624a939-040a-4e1f-bbda-841281b0e143 tempest-VolumesSnapshotsTestJSON-2008636442 tempest-VolumesSnapshotsTestJSON-2008636442-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/8b6ebcb6-26d7-4c5d-baaf-aa32c326a9ca" status: 200 len: 344 microversion: 2.1 time: 0.094556 Jan 21 09:39:40.999740 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 360/719] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Jan 21 09:39:40 2022] GET /compute/v2.1/os-volumes/8b6ebcb6-26d7-4c5d-baaf-aa32c326a9ca => generated 344 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 09:39:41.008107 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-3c992a74-6326-42a2-836b-3a3af1ea43cc tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:39:41.009300 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-3c992a74-6326-42a2-836b-3a3af1ea43cc tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:39:41.014197 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-3c992a74-6326-42a2-836b-3a3af1ea43cc tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:39:41.014197 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-3c992a74-6326-42a2-836b-3a3af1ea43cc tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:39:41.017642 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-bd9d47be-b3c9-4e4b-a4bf-b8704d1b6a38 tempest-VolumesSnapshotsTestJSON-2008636442 tempest-VolumesSnapshotsTestJSON-2008636442-project] Action: 'create', calling method: .version_select at 0x7fb6c2b8eb80>, body: {"snapshot": {"volume_id": "8b6ebcb6-26d7-4c5d-baaf-aa32c326a9ca", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1482856157"}} {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:39:41.188371 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-3c992a74-6326-42a2-836b-3a3af1ea43cc tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d53a7fa2cb5498aa916817b82dba77e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515ded26ca114fbf9c6e920362aec64c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:39:41.197398 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-3c992a74-6326-42a2-836b-3a3af1ea43cc tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] 10.222.0.45 "GET /compute/v2.1/servers/2733931f-f68e-4f48-85d2-5060a8f55eec" status: 200 len: 1265 microversion: 2.1 time: 0.206393 Jan 21 09:39:41.207799 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 360/720] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:39:40 2022] GET /compute/v2.1/servers/2733931f-f68e-4f48-85d2-5060a8f55eec => generated 1265 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:39:41.510257 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-bd9d47be-b3c9-4e4b-a4bf-b8704d1b6a38 tempest-VolumesSnapshotsTestJSON-2008636442 tempest-VolumesSnapshotsTestJSON-2008636442-project] 10.222.0.45 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.499137 Jan 21 09:39:41.510839 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 361/721] 10.222.0.45 () {60 vars in 1161 bytes} [Fri Jan 21 09:39:41 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 09:39:41.527475 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-a0b0c843-b265-4909-b7de-156ade6ecef0 tempest-VolumesSnapshotsTestJSON-2008636442 tempest-VolumesSnapshotsTestJSON-2008636442-project] Calling method '.version_select at 0x7fb6c2c805e0>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:39:41.557542 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-a0b0c843-b265-4909-b7de-156ade6ecef0 tempest-VolumesSnapshotsTestJSON-2008636442 tempest-VolumesSnapshotsTestJSON-2008636442-project] 10.222.0.45 "GET /compute/v2.1/os-snapshots/31b93f80-0183-4260-a5cd-c649f28d0444" status: 200 len: 287 microversion: 2.1 time: 0.033613 Jan 21 09:39:41.558116 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 361/722] 10.222.0.45 () {58 vars in 1250 bytes} [Fri Jan 21 09:39:41 2022] GET /compute/v2.1/os-snapshots/31b93f80-0183-4260-a5cd-c649f28d0444 => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 09:39:41.568438 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-1adff244-b44d-486f-8a86-0158137b954c tempest-VolumesSnapshotsTestJSON-2008636442 tempest-VolumesSnapshotsTestJSON-2008636442-project] Calling method '.version_select at 0x7fb6c2b2e430>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:39:41.597670 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-1adff244-b44d-486f-8a86-0158137b954c tempest-VolumesSnapshotsTestJSON-2008636442 tempest-VolumesSnapshotsTestJSON-2008636442-project] 10.222.0.45 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.033464 Jan 21 09:39:41.598298 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 362/723] 10.222.0.45 () {58 vars in 1139 bytes} [Fri Jan 21 09:39:41 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 09:39:41.608695 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-ba0ec06a-4898-4eaa-94af-eb2cb32f0130 tempest-VolumesSnapshotsTestJSON-2008636442 tempest-VolumesSnapshotsTestJSON-2008636442-project] Calling method '.version_select at 0x7fb6c2cac9d0>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:39:41.640082 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-ba0ec06a-4898-4eaa-94af-eb2cb32f0130 tempest-VolumesSnapshotsTestJSON-2008636442 tempest-VolumesSnapshotsTestJSON-2008636442-project] 10.222.0.45 "GET /compute/v2.1/os-snapshots/31b93f80-0183-4260-a5cd-c649f28d0444" status: 200 len: 287 microversion: 2.1 time: 0.034956 Jan 21 09:39:41.640614 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 362/724] 10.222.0.45 () {58 vars in 1250 bytes} [Fri Jan 21 09:39:41 2022] GET /compute/v2.1/os-snapshots/31b93f80-0183-4260-a5cd-c649f28d0444 => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 09:39:41.948315 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-40714ea0-84a6-4c68-a4af-4dfc17bfc393 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:39:41.948951 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-40714ea0-84a6-4c68-a4af-4dfc17bfc393 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] [instance: 4e67b25e-7e65-4975-bafa-fceafcd53647] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:39:41.955015 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-40714ea0-84a6-4c68-a4af-4dfc17bfc393 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:39:41.955462 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-40714ea0-84a6-4c68-a4af-4dfc17bfc393 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:39:41.956327 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-40714ea0-84a6-4c68-a4af-4dfc17bfc393 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:39:41.956761 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-40714ea0-84a6-4c68-a4af-4dfc17bfc393 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:39:41.993670 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-40714ea0-84a6-4c68-a4af-4dfc17bfc393 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:39:41.994112 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-40714ea0-84a6-4c68-a4af-4dfc17bfc393 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:39:41.994559 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.objects.instance [None req-40714ea0-84a6-4c68-a4af-4dfc17bfc393 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lazy-loading 'fault' on Instance uuid 4e67b25e-7e65-4975-bafa-fceafcd53647 {{(pid=123387) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 21 09:39:42.034928 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-40714ea0-84a6-4c68-a4af-4dfc17bfc393 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db87258db1424ce7a8399fdd05efe3b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89d1b21ad8471a8a9a82adac2594c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:39:42.042259 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-40714ea0-84a6-4c68-a4af-4dfc17bfc393 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] 10.222.0.45 "GET /compute/v2.1/servers/4e67b25e-7e65-4975-bafa-fceafcd53647" status: 200 len: 1311 microversion: 2.1 time: 0.098077 Jan 21 09:39:42.042827 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 363/725] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:39:41 2022] GET /compute/v2.1/servers/4e67b25e-7e65-4975-bafa-fceafcd53647 => generated 1311 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:39:42.215265 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-0f5b8b9e-c15e-4b1f-98f5-4098b8533562 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:39:42.218142 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-0f5b8b9e-c15e-4b1f-98f5-4098b8533562 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] [instance: 2733931f-f68e-4f48-85d2-5060a8f55eec] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:39:42.223192 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-0f5b8b9e-c15e-4b1f-98f5-4098b8533562 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:39:42.223717 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-0f5b8b9e-c15e-4b1f-98f5-4098b8533562 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:39:42.224590 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-0f5b8b9e-c15e-4b1f-98f5-4098b8533562 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:39:42.225123 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-0f5b8b9e-c15e-4b1f-98f5-4098b8533562 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:39:42.375185 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-0f5b8b9e-c15e-4b1f-98f5-4098b8533562 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d53a7fa2cb5498aa916817b82dba77e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515ded26ca114fbf9c6e920362aec64c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:39:42.385381 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-0f5b8b9e-c15e-4b1f-98f5-4098b8533562 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] 10.222.0.45 "GET /compute/v2.1/servers/2733931f-f68e-4f48-85d2-5060a8f55eec" status: 200 len: 1452 microversion: 2.1 time: 0.173205 Jan 21 09:39:42.386148 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 363/726] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:39:42 2022] GET /compute/v2.1/servers/2733931f-f68e-4f48-85d2-5060a8f55eec => generated 1452 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:39:42.404100 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-cfaf11f7-9ceb-4718-9bae-291e695298bc tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:39:42.404631 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-cfaf11f7-9ceb-4718-9bae-291e695298bc tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] [instance: 2733931f-f68e-4f48-85d2-5060a8f55eec] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:39:42.410643 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-cfaf11f7-9ceb-4718-9bae-291e695298bc tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:39:42.411088 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-cfaf11f7-9ceb-4718-9bae-291e695298bc tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:39:42.411875 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-cfaf11f7-9ceb-4718-9bae-291e695298bc tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:39:42.412313 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-cfaf11f7-9ceb-4718-9bae-291e695298bc tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:39:42.550080 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-cfaf11f7-9ceb-4718-9bae-291e695298bc tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d53a7fa2cb5498aa916817b82dba77e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515ded26ca114fbf9c6e920362aec64c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:39:42.557387 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-cfaf11f7-9ceb-4718-9bae-291e695298bc tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] 10.222.0.45 "GET /compute/v2.1/servers/2733931f-f68e-4f48-85d2-5060a8f55eec" status: 200 len: 1452 microversion: 2.1 time: 0.157067 Jan 21 09:39:42.557955 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 364/727] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:39:42 2022] GET /compute/v2.1/servers/2733931f-f68e-4f48-85d2-5060a8f55eec => generated 1452 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:39:42.651720 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-c2a1b352-b956-4979-938c-86e8ce3a5753 tempest-VolumesSnapshotsTestJSON-2008636442 tempest-VolumesSnapshotsTestJSON-2008636442-project] Calling method '.version_select at 0x7fb6c2cb9a60>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:39:42.681114 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-c2a1b352-b956-4979-938c-86e8ce3a5753 tempest-VolumesSnapshotsTestJSON-2008636442 tempest-VolumesSnapshotsTestJSON-2008636442-project] 10.222.0.45 "GET /compute/v2.1/os-snapshots/31b93f80-0183-4260-a5cd-c649f28d0444" status: 200 len: 287 microversion: 2.1 time: 0.033057 Jan 21 09:39:42.681704 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 364/728] 10.222.0.45 () {58 vars in 1250 bytes} [Fri Jan 21 09:39:42 2022] GET /compute/v2.1/os-snapshots/31b93f80-0183-4260-a5cd-c649f28d0444 => generated 287 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 09:39:43.058809 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-c32c1ba0-f928-4122-be10-5d3be50fad66 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:39:43.059425 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-c32c1ba0-f928-4122-be10-5d3be50fad66 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] [instance: 4e67b25e-7e65-4975-bafa-fceafcd53647] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:39:43.067042 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-c32c1ba0-f928-4122-be10-5d3be50fad66 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:39:43.067725 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-c32c1ba0-f928-4122-be10-5d3be50fad66 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:39:43.068951 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-c32c1ba0-f928-4122-be10-5d3be50fad66 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:39:43.069644 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-c32c1ba0-f928-4122-be10-5d3be50fad66 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:39:43.086947 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.wsgi [None req-c32c1ba0-f928-4122-be10-5d3be50fad66 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] HTTP exception thrown: Instance 4e67b25e-7e65-4975-bafa-fceafcd53647 could not be found. Jan 21 09:39:43.087548 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-c32c1ba0-f928-4122-be10-5d3be50fad66 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] Returning 404 to user: Instance 4e67b25e-7e65-4975-bafa-fceafcd53647 could not be found. {{(pid=123387) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 21 09:39:43.088392 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-c32c1ba0-f928-4122-be10-5d3be50fad66 tempest-ServerRescueNegativeTestJSON-713127355 tempest-ServerRescueNegativeTestJSON-713127355-project] 10.222.0.45 "GET /compute/v2.1/servers/4e67b25e-7e65-4975-bafa-fceafcd53647" status: 404 len: 111 microversion: 2.1 time: 0.033407 Jan 21 09:39:43.088953 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 365/729] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:39:43 2022] GET /compute/v2.1/servers/4e67b25e-7e65-4975-bafa-fceafcd53647 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 21 09:39:43.692551 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-de3005b8-0ac2-4e51-8b7f-172793e8e0b9 tempest-VolumesSnapshotsTestJSON-2008636442 tempest-VolumesSnapshotsTestJSON-2008636442-project] Calling method '.version_select at 0x7fb6c2cacd30>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:39:43.726235 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-de3005b8-0ac2-4e51-8b7f-172793e8e0b9 tempest-VolumesSnapshotsTestJSON-2008636442 tempest-VolumesSnapshotsTestJSON-2008636442-project] 10.222.0.45 "GET /compute/v2.1/os-snapshots/31b93f80-0183-4260-a5cd-c649f28d0444" status: 200 len: 287 microversion: 2.1 time: 0.038005 Jan 21 09:39:43.726977 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 365/730] 10.222.0.45 () {58 vars in 1250 bytes} [Fri Jan 21 09:39:43 2022] GET /compute/v2.1/os-snapshots/31b93f80-0183-4260-a5cd-c649f28d0444 => generated 287 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 09:39:44.739229 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-742599e9-f2cb-461c-9b78-7cafa0560de7 tempest-VolumesSnapshotsTestJSON-2008636442 tempest-VolumesSnapshotsTestJSON-2008636442-project] Calling method '.version_select at 0x7fb6c2ad8670>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:39:44.772018 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-742599e9-f2cb-461c-9b78-7cafa0560de7 tempest-VolumesSnapshotsTestJSON-2008636442 tempest-VolumesSnapshotsTestJSON-2008636442-project] 10.222.0.45 "GET /compute/v2.1/os-snapshots/31b93f80-0183-4260-a5cd-c649f28d0444" status: 200 len: 287 microversion: 2.1 time: 0.037502 Jan 21 09:39:44.773167 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 366/731] 10.222.0.45 () {58 vars in 1250 bytes} [Fri Jan 21 09:39:44 2022] GET /compute/v2.1/os-snapshots/31b93f80-0183-4260-a5cd-c649f28d0444 => generated 287 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 09:39:44.979839 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [req-bc4a9b1d-0689-4a32-bb10-26f774c425de req-760a7ddf-d085-45cb-bfd7-0d03d987af12 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2733931f-f68e-4f48-85d2-5060a8f55eec", "tag": "fdcd5489-3e9c-4a62-8bc8-26a5c193cc04"}]} {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:39:44.981827 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 21 09:39:44.981827 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: warnings.warn(msg) Jan 21 09:39:44.991420 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [req-bc4a9b1d-0689-4a32-bb10-26f774c425de req-760a7ddf-d085-45cb-bfd7-0d03d987af12 service nova] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:39:44.992073 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [req-bc4a9b1d-0689-4a32-bb10-26f774c425de req-760a7ddf-d085-45cb-bfd7-0d03d987af12 service nova] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:39:45.003504 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.compute.server_external_events [req-bc4a9b1d-0689-4a32-bb10-26f774c425de req-760a7ddf-d085-45cb-bfd7-0d03d987af12 service nova] Creating event network-changed:fdcd5489-3e9c-4a62-8bc8-26a5c193cc04 for instance 2733931f-f68e-4f48-85d2-5060a8f55eec on hv-cinder-80403 Jan 21 09:39:45.010378 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [req-bc4a9b1d-0689-4a32-bb10-26f774c425de req-760a7ddf-d085-45cb-bfd7-0d03d987af12 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033699 Jan 21 09:39:45.010378 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 366/732] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Jan 21 09:39:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 09:39:45.787419 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-b5eb5585-fb02-471b-8bbf-d5fb3a493140 tempest-VolumesSnapshotsTestJSON-2008636442 tempest-VolumesSnapshotsTestJSON-2008636442-project] Calling method '.version_select at 0x7fb6c2acd820>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:39:45.839866 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-b5eb5585-fb02-471b-8bbf-d5fb3a493140 tempest-VolumesSnapshotsTestJSON-2008636442 tempest-VolumesSnapshotsTestJSON-2008636442-project] 10.222.0.45 "GET /compute/v2.1/os-snapshots/31b93f80-0183-4260-a5cd-c649f28d0444" status: 200 len: 288 microversion: 2.1 time: 0.056479 Jan 21 09:39:45.840727 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 367/733] 10.222.0.45 () {58 vars in 1250 bytes} [Fri Jan 21 09:39:45 2022] GET /compute/v2.1/os-snapshots/31b93f80-0183-4260-a5cd-c649f28d0444 => generated 288 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 09:39:45.852451 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-943cc10b-dae3-4217-a625-ddfbba14afa9 tempest-VolumesSnapshotsTestJSON-2008636442 tempest-VolumesSnapshotsTestJSON-2008636442-project] Calling method '.version_select at 0x7fb6c2ce6160>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:39:46.053944 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-943cc10b-dae3-4217-a625-ddfbba14afa9 tempest-VolumesSnapshotsTestJSON-2008636442 tempest-VolumesSnapshotsTestJSON-2008636442-project] 10.222.0.45 "DELETE /compute/v2.1/os-snapshots/31b93f80-0183-4260-a5cd-c649f28d0444" status: 202 len: 0 microversion: 2.1 time: 0.205356 Jan 21 09:39:46.054833 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 367/734] 10.222.0.45 () {58 vars in 1253 bytes} [Fri Jan 21 09:39:45 2022] DELETE /compute/v2.1/os-snapshots/31b93f80-0183-4260-a5cd-c649f28d0444 => generated 0 bytes in 208 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 21 09:39:46.067814 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-f8ab6242-73a3-458f-86be-d185c80aadd2 tempest-VolumesSnapshotsTestJSON-2008636442 tempest-VolumesSnapshotsTestJSON-2008636442-project] Calling method '.version_select at 0x7fb6c2ad89d0>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:39:46.149240 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-f8ab6242-73a3-458f-86be-d185c80aadd2 tempest-VolumesSnapshotsTestJSON-2008636442 tempest-VolumesSnapshotsTestJSON-2008636442-project] 10.222.0.45 "GET /compute/v2.1/os-snapshots/31b93f80-0183-4260-a5cd-c649f28d0444" status: 200 len: 287 microversion: 2.1 time: 0.087907 Jan 21 09:39:46.149240 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 368/735] 10.222.0.45 () {58 vars in 1250 bytes} [Fri Jan 21 09:39:46 2022] GET /compute/v2.1/os-snapshots/31b93f80-0183-4260-a5cd-c649f28d0444 => generated 287 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 09:39:47.160077 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-504af6be-3be6-40db-b8cd-787688205bf0 tempest-VolumesSnapshotsTestJSON-2008636442 tempest-VolumesSnapshotsTestJSON-2008636442-project] Calling method '.version_select at 0x7fb6c3577550>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:39:47.203990 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.wsgi [None req-504af6be-3be6-40db-b8cd-787688205bf0 tempest-VolumesSnapshotsTestJSON-2008636442 tempest-VolumesSnapshotsTestJSON-2008636442-project] HTTP exception thrown: Snapshot 31b93f80-0183-4260-a5cd-c649f28d0444 could not be found. Jan 21 09:39:47.204579 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-504af6be-3be6-40db-b8cd-787688205bf0 tempest-VolumesSnapshotsTestJSON-2008636442 tempest-VolumesSnapshotsTestJSON-2008636442-project] Returning 404 to user: Snapshot 31b93f80-0183-4260-a5cd-c649f28d0444 could not be found. {{(pid=123386) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 21 09:39:47.206182 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-504af6be-3be6-40db-b8cd-787688205bf0 tempest-VolumesSnapshotsTestJSON-2008636442 tempest-VolumesSnapshotsTestJSON-2008636442-project] 10.222.0.45 "GET /compute/v2.1/os-snapshots/31b93f80-0183-4260-a5cd-c649f28d0444" status: 404 len: 111 microversion: 2.1 time: 0.050163 Jan 21 09:39:47.207560 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 368/736] 10.222.0.45 () {58 vars in 1250 bytes} [Fri Jan 21 09:39:47 2022] GET /compute/v2.1/os-snapshots/31b93f80-0183-4260-a5cd-c649f28d0444 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 21 09:39:47.221063 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-d4d69105-12b8-4937-bc94-a0874bbc95a3 tempest-VolumesSnapshotsTestJSON-2008636442 tempest-VolumesSnapshotsTestJSON-2008636442-project] Calling method '.version_select at 0x7fb6c2b79c10>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:39:47.421881 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-d4d69105-12b8-4937-bc94-a0874bbc95a3 tempest-VolumesSnapshotsTestJSON-2008636442 tempest-VolumesSnapshotsTestJSON-2008636442-project] 10.222.0.45 "DELETE /compute/v2.1/os-volumes/8b6ebcb6-26d7-4c5d-baaf-aa32c326a9ca" status: 202 len: 0 microversion: 2.1 time: 0.204857 Jan 21 09:39:47.422822 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 369/737] 10.222.0.45 () {58 vars in 1247 bytes} [Fri Jan 21 09:39:47 2022] DELETE /compute/v2.1/os-volumes/8b6ebcb6-26d7-4c5d-baaf-aa32c326a9ca => generated 0 bytes in 206 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 21 09:39:47.432013 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-4598ee7a-5823-4dd7-a5fa-34229d9c8d93 tempest-VolumesSnapshotsTestJSON-2008636442 tempest-VolumesSnapshotsTestJSON-2008636442-project] Calling method '.version_select at 0x7fb6c80aeca0>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:39:47.482932 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-4598ee7a-5823-4dd7-a5fa-34229d9c8d93 tempest-VolumesSnapshotsTestJSON-2008636442 tempest-VolumesSnapshotsTestJSON-2008636442-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/8b6ebcb6-26d7-4c5d-baaf-aa32c326a9ca" status: 200 len: 343 microversion: 2.1 time: 0.054855 Jan 21 09:39:47.483593 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 369/738] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Jan 21 09:39:47 2022] GET /compute/v2.1/os-volumes/8b6ebcb6-26d7-4c5d-baaf-aa32c326a9ca => generated 343 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 09:39:48.496323 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-ac1b3484-19bf-473c-ab3c-0f44b34c3502 tempest-VolumesSnapshotsTestJSON-2008636442 tempest-VolumesSnapshotsTestJSON-2008636442-project] Calling method '.version_select at 0x7fb6c2acd8b0>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:39:48.525337 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.wsgi [None req-ac1b3484-19bf-473c-ab3c-0f44b34c3502 tempest-VolumesSnapshotsTestJSON-2008636442 tempest-VolumesSnapshotsTestJSON-2008636442-project] HTTP exception thrown: Volume 8b6ebcb6-26d7-4c5d-baaf-aa32c326a9ca could not be found. Jan 21 09:39:48.526004 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-ac1b3484-19bf-473c-ab3c-0f44b34c3502 tempest-VolumesSnapshotsTestJSON-2008636442 tempest-VolumesSnapshotsTestJSON-2008636442-project] Returning 404 to user: Volume 8b6ebcb6-26d7-4c5d-baaf-aa32c326a9ca could not be found. {{(pid=123387) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 21 09:39:48.526872 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-ac1b3484-19bf-473c-ab3c-0f44b34c3502 tempest-VolumesSnapshotsTestJSON-2008636442 tempest-VolumesSnapshotsTestJSON-2008636442-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/8b6ebcb6-26d7-4c5d-baaf-aa32c326a9ca" status: 404 len: 109 microversion: 2.1 time: 0.034712 Jan 21 09:39:48.527421 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 370/739] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Jan 21 09:39:48 2022] GET /compute/v2.1/os-volumes/8b6ebcb6-26d7-4c5d-baaf-aa32c326a9ca => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 21 09:39:48.537225 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-0b9e404a-e238-44c1-be51-dac542f21d26 tempest-VolumesSnapshotsTestJSON-2008636442 tempest-VolumesSnapshotsTestJSON-2008636442-project] Calling method '.version_select at 0x7fb6c2cacee0>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:39:48.565323 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.wsgi [None req-0b9e404a-e238-44c1-be51-dac542f21d26 tempest-VolumesSnapshotsTestJSON-2008636442 tempest-VolumesSnapshotsTestJSON-2008636442-project] HTTP exception thrown: Volume 8b6ebcb6-26d7-4c5d-baaf-aa32c326a9ca could not be found. Jan 21 09:39:48.566017 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-0b9e404a-e238-44c1-be51-dac542f21d26 tempest-VolumesSnapshotsTestJSON-2008636442 tempest-VolumesSnapshotsTestJSON-2008636442-project] Returning 404 to user: Volume 8b6ebcb6-26d7-4c5d-baaf-aa32c326a9ca could not be found. {{(pid=123386) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 21 09:39:48.566863 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-0b9e404a-e238-44c1-be51-dac542f21d26 tempest-VolumesSnapshotsTestJSON-2008636442 tempest-VolumesSnapshotsTestJSON-2008636442-project] 10.222.0.45 "DELETE /compute/v2.1/os-volumes/8b6ebcb6-26d7-4c5d-baaf-aa32c326a9ca" status: 404 len: 109 microversion: 2.1 time: 0.034000 Jan 21 09:39:48.567412 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 370/740] 10.222.0.45 () {58 vars in 1247 bytes} [Fri Jan 21 09:39:48 2022] DELETE /compute/v2.1/os-volumes/8b6ebcb6-26d7-4c5d-baaf-aa32c326a9ca => generated 109 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 21 09:39:48.575805 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-4fadd124-7338-4bde-9ca7-62bc85fee2e5 tempest-VolumesSnapshotsTestJSON-2008636442 tempest-VolumesSnapshotsTestJSON-2008636442-project] Calling method '.version_select at 0x7fb6c2b67700>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:39:48.603722 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.wsgi [None req-4fadd124-7338-4bde-9ca7-62bc85fee2e5 tempest-VolumesSnapshotsTestJSON-2008636442 tempest-VolumesSnapshotsTestJSON-2008636442-project] HTTP exception thrown: Volume 8b6ebcb6-26d7-4c5d-baaf-aa32c326a9ca could not be found. Jan 21 09:39:48.604311 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-4fadd124-7338-4bde-9ca7-62bc85fee2e5 tempest-VolumesSnapshotsTestJSON-2008636442 tempest-VolumesSnapshotsTestJSON-2008636442-project] Returning 404 to user: Volume 8b6ebcb6-26d7-4c5d-baaf-aa32c326a9ca could not be found. {{(pid=123387) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 21 09:39:48.605277 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-4fadd124-7338-4bde-9ca7-62bc85fee2e5 tempest-VolumesSnapshotsTestJSON-2008636442 tempest-VolumesSnapshotsTestJSON-2008636442-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/8b6ebcb6-26d7-4c5d-baaf-aa32c326a9ca" status: 404 len: 109 microversion: 2.1 time: 0.033080 Jan 21 09:39:48.605813 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 371/741] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Jan 21 09:39:48 2022] GET /compute/v2.1/os-volumes/8b6ebcb6-26d7-4c5d-baaf-aa32c326a9ca => generated 109 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 21 09:39:50.795477 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-17c94228-e04d-47fe-b9a6-3a1982cd9a36 tempest-VolumesGetTestJSON-1193502529 tempest-VolumesGetTestJSON-1193502529-project] Action: 'create', calling method: .version_select at 0x7fb6c2c805e0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-2116328734", "metadata": {"Type": "work"}}} {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:39:51.457755 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-17c94228-e04d-47fe-b9a6-3a1982cd9a36 tempest-VolumesGetTestJSON-1193502529 tempest-VolumesGetTestJSON-1193502529-project] 10.222.0.45 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.807888 Jan 21 09:39:51.458510 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 371/742] 10.222.0.45 () {60 vars in 1155 bytes} [Fri Jan 21 09:39:50 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 809 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jan 21 09:39:51.470148 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-792f62fb-698f-43ca-9de0-64a15bc126e4 tempest-VolumesGetTestJSON-1193502529 tempest-VolumesGetTestJSON-1193502529-project] Calling method '.version_select at 0x7fb6c2e24f70>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:39:51.529069 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-792f62fb-698f-43ca-9de0-64a15bc126e4 tempest-VolumesGetTestJSON-1193502529 tempest-VolumesGetTestJSON-1193502529-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/2574d0ec-cee5-403c-af59-57b8ebbe49ab" status: 200 len: 353 microversion: 2.1 time: 0.063612 Jan 21 09:39:51.530439 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 372/743] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Jan 21 09:39:51 2022] GET /compute/v2.1/os-volumes/2574d0ec-cee5-403c-af59-57b8ebbe49ab => generated 353 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 09:39:52.542252 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-9d7def85-6031-4f9d-a198-02341d3100f8 tempest-VolumesGetTestJSON-1193502529 tempest-VolumesGetTestJSON-1193502529-project] Calling method '.version_select at 0x7fb6c2cacee0>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:39:52.592912 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-9d7def85-6031-4f9d-a198-02341d3100f8 tempest-VolumesGetTestJSON-1193502529 tempest-VolumesGetTestJSON-1193502529-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/2574d0ec-cee5-403c-af59-57b8ebbe49ab" status: 200 len: 353 microversion: 2.1 time: 0.054620 Jan 21 09:39:52.593753 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 372/744] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Jan 21 09:39:52 2022] GET /compute/v2.1/os-volumes/2574d0ec-cee5-403c-af59-57b8ebbe49ab => generated 353 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 09:39:53.605940 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-1ac25269-8f96-4cb6-8962-ad2d45b2a2ae tempest-VolumesGetTestJSON-1193502529 tempest-VolumesGetTestJSON-1193502529-project] Calling method '.version_select at 0x7fb6c2b4f430>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:39:53.664777 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-1ac25269-8f96-4cb6-8962-ad2d45b2a2ae tempest-VolumesGetTestJSON-1193502529 tempest-VolumesGetTestJSON-1193502529-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/2574d0ec-cee5-403c-af59-57b8ebbe49ab" status: 200 len: 354 microversion: 2.1 time: 0.062303 Jan 21 09:39:53.665468 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 373/745] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Jan 21 09:39:53 2022] GET /compute/v2.1/os-volumes/2574d0ec-cee5-403c-af59-57b8ebbe49ab => generated 354 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 09:39:53.676197 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-c11a0e8c-e570-4ef4-8fdc-1b542e92d1e5 tempest-VolumesGetTestJSON-1193502529 tempest-VolumesGetTestJSON-1193502529-project] Calling method '.version_select at 0x7fb6c36f1550>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:39:53.726947 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-c11a0e8c-e570-4ef4-8fdc-1b542e92d1e5 tempest-VolumesGetTestJSON-1193502529 tempest-VolumesGetTestJSON-1193502529-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/2574d0ec-cee5-403c-af59-57b8ebbe49ab" status: 200 len: 354 microversion: 2.1 time: 0.054372 Jan 21 09:39:53.727634 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 373/746] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Jan 21 09:39:53 2022] GET /compute/v2.1/os-volumes/2574d0ec-cee5-403c-af59-57b8ebbe49ab => generated 354 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 09:39:53.744633 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-e203e087-b1f5-4bbe-986a-e651df604dda tempest-VolumesGetTestJSON-1193502529 tempest-VolumesGetTestJSON-1193502529-project] Calling method '.version_select at 0x7fb6c2ad8940>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:39:53.920096 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-e203e087-b1f5-4bbe-986a-e651df604dda tempest-VolumesGetTestJSON-1193502529 tempest-VolumesGetTestJSON-1193502529-project] 10.222.0.45 "DELETE /compute/v2.1/os-volumes/2574d0ec-cee5-403c-af59-57b8ebbe49ab" status: 202 len: 0 microversion: 2.1 time: 0.179074 Jan 21 09:39:53.933126 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 374/747] 10.222.0.45 () {58 vars in 1247 bytes} [Fri Jan 21 09:39:53 2022] DELETE /compute/v2.1/os-volumes/2574d0ec-cee5-403c-af59-57b8ebbe49ab => generated 0 bytes in 193 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 21 09:39:53.942433 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-4dc852e8-8ff4-4244-8fdd-1c37f88189a6 tempest-VolumesGetTestJSON-1193502529 tempest-VolumesGetTestJSON-1193502529-project] Calling method '.version_select at 0x7fb6c2c45430>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:39:54.063924 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-4dc852e8-8ff4-4244-8fdd-1c37f88189a6 tempest-VolumesGetTestJSON-1193502529 tempest-VolumesGetTestJSON-1193502529-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/2574d0ec-cee5-403c-af59-57b8ebbe49ab" status: 200 len: 353 microversion: 2.1 time: 0.126668 Jan 21 09:39:54.065201 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 374/748] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Jan 21 09:39:53 2022] GET /compute/v2.1/os-volumes/2574d0ec-cee5-403c-af59-57b8ebbe49ab => generated 353 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 21 09:39:55.077410 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-0460967c-1e26-40e1-aef9-dbfc3867151d tempest-VolumesGetTestJSON-1193502529 tempest-VolumesGetTestJSON-1193502529-project] Calling method '.version_select at 0x7fb6c2c91ca0>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:39:55.098895 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-2d671836-a978-4196-afeb-59e193b93874 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Action: 'create', calling method: .version_select at 0x7fb6c2ae6430>, body: {"keypair": {"name": "tempest-keypair-1631447357"}} {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:39:55.123870 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.wsgi [None req-0460967c-1e26-40e1-aef9-dbfc3867151d tempest-VolumesGetTestJSON-1193502529 tempest-VolumesGetTestJSON-1193502529-project] HTTP exception thrown: Volume 2574d0ec-cee5-403c-af59-57b8ebbe49ab could not be found. Jan 21 09:39:55.125889 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-0460967c-1e26-40e1-aef9-dbfc3867151d tempest-VolumesGetTestJSON-1193502529 tempest-VolumesGetTestJSON-1193502529-project] Returning 404 to user: Volume 2574d0ec-cee5-403c-af59-57b8ebbe49ab could not be found. {{(pid=123386) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 21 09:39:55.127772 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-0460967c-1e26-40e1-aef9-dbfc3867151d tempest-VolumesGetTestJSON-1193502529 tempest-VolumesGetTestJSON-1193502529-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/2574d0ec-cee5-403c-af59-57b8ebbe49ab" status: 404 len: 109 microversion: 2.1 time: 0.054711 Jan 21 09:39:55.129571 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 375/749] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Jan 21 09:39:55 2022] GET /compute/v2.1/os-volumes/2574d0ec-cee5-403c-af59-57b8ebbe49ab => generated 109 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 21 09:39:55.145561 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.quota [None req-2d671836-a978-4196-afeb-59e193b93874 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Getting quotas for project 2322cb784615409bb15a6f49522d3b34. Resources: {'key_pairs'} {{(pid=123387) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 21 09:39:55.149915 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.quota [None req-2d671836-a978-4196-afeb-59e193b93874 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Getting quotas for user 590e721135c84df5946147ac7e944fbc and project 2322cb784615409bb15a6f49522d3b34. Resources: {'key_pairs'} {{(pid=123387) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 21 09:39:55.391120 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.quota [None req-2d671836-a978-4196-afeb-59e193b93874 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Getting quotas for project 2322cb784615409bb15a6f49522d3b34. Resources: {'key_pairs'} {{(pid=123387) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 21 09:39:55.397375 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.quota [None req-2d671836-a978-4196-afeb-59e193b93874 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Getting quotas for user 590e721135c84df5946147ac7e944fbc and project 2322cb784615409bb15a6f49522d3b34. Resources: {'key_pairs'} {{(pid=123387) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 21 09:39:55.415802 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-2d671836-a978-4196-afeb-59e193b93874 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 2301 microversion: 2.1 time: 0.402304 Jan 21 09:39:55.421844 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 375/750] 10.222.0.45 () {60 vars in 1157 bytes} [Fri Jan 21 09:39:55 2022] POST /compute/v2.1/os-keypairs => generated 2301 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:39:58.164286 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-0ff0bc34-8aa9-43f8-b9e9-53b327c69979 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1050095901", "imageRef": "813e53ee-82e7-4a13-9f63-a8be7b1089f1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0dd36bcf-7b04-41a7-a991-1f81f12526d5"}], "security_groups": [{"name": "tempest-securitygroup--1354384332"}], "key_name": "tempest-keypair-1631447357", "user_data": "}} {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:39:58.301259 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.network.neutron [None req-0ff0bc34-8aa9-43f8-b9e9-53b327c69979 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] validate_networks() for [('0dd36bcf-7b04-41a7-a991-1f81f12526d5', None, None, None, None, None)] {{(pid=123386) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 21 09:39:58.822913 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.virt.hardware [None req-0ff0bc34-8aa9-43f8-b9e9-53b327c69979 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Flavor limits 0:0:0 {{(pid=123386) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 21 09:39:58.823335 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.virt.hardware [None req-0ff0bc34-8aa9-43f8-b9e9-53b327c69979 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Image limits 0:0:0 {{(pid=123386) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 21 09:39:58.829255 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.virt.hardware [None req-0ff0bc34-8aa9-43f8-b9e9-53b327c69979 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Flavor pref 0:0:0 {{(pid=123386) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 21 09:39:58.829255 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.virt.hardware [None req-0ff0bc34-8aa9-43f8-b9e9-53b327c69979 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Image pref 0:0:0 {{(pid=123386) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 21 09:39:58.829255 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.virt.hardware [None req-0ff0bc34-8aa9-43f8-b9e9-53b327c69979 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123386) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 21 09:39:58.834719 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-0ff0bc34-8aa9-43f8-b9e9-53b327c69979 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:39:58.835170 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-0ff0bc34-8aa9-43f8-b9e9-53b327c69979 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:39:58.835988 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-0ff0bc34-8aa9-43f8-b9e9-53b327c69979 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:39:58.836547 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-0ff0bc34-8aa9-43f8-b9e9-53b327c69979 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:39:58.857809 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.quota [None req-0ff0bc34-8aa9-43f8-b9e9-53b327c69979 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Getting quotas for project 2322cb784615409bb15a6f49522d3b34. Resources: {'cores', 'instances', 'ram'} {{(pid=123386) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 21 09:39:58.859350 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.quota [None req-0ff0bc34-8aa9-43f8-b9e9-53b327c69979 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Getting quotas for user 590e721135c84df5946147ac7e944fbc and project 2322cb784615409bb15a6f49522d3b34. Resources: {'cores', 'instances', 'ram'} {{(pid=123386) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 21 09:39:58.872566 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-0ff0bc34-8aa9-43f8-b9e9-53b327c69979 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Going to run 1 instances... {{(pid=123386) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 21 09:39:58.875254 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-0ff0bc34-8aa9-43f8-b9e9-53b327c69979 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] [instance: 9c18953a-7af3-4d71-97ad-05eda7e34a73] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='813e53ee-82e7-4a13-9f63-a8be7b1089f1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123386) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 21 09:39:59.047098 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-0ff0bc34-8aa9-43f8-b9e9-53b327c69979 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.891788 Jan 21 09:39:59.047744 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 376/751] 10.222.0.45 () {60 vars in 1146 bytes} [Fri Jan 21 09:39:58 2022] POST /compute/v2.1/servers => generated 402 bytes in 893 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 21 09:39:59.065055 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-d1c8cc3d-7178-48d5-b352-6e75bbf7f9bc tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:39:59.065851 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-d1c8cc3d-7178-48d5-b352-6e75bbf7f9bc tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] [instance: 9c18953a-7af3-4d71-97ad-05eda7e34a73] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:39:59.139509 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-d1c8cc3d-7178-48d5-b352-6e75bbf7f9bc tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '590e721135c84df5946147ac7e944fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2322cb784615409bb15a6f49522d3b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:39:59.150265 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-d1c8cc3d-7178-48d5-b352-6e75bbf7f9bc tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] 10.222.0.45 "GET /compute/v2.1/servers/9c18953a-7af3-4d71-97ad-05eda7e34a73" status: 200 len: 1238 microversion: 2.1 time: 0.095519 Jan 21 09:39:59.160494 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 376/752] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:39:59 2022] GET /compute/v2.1/servers/9c18953a-7af3-4d71-97ad-05eda7e34a73 => generated 1238 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:40:00.169885 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-368c9ba1-08bf-40b6-ae20-1d7965d096d5 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:40:00.170402 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-368c9ba1-08bf-40b6-ae20-1d7965d096d5 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] [instance: 9c18953a-7af3-4d71-97ad-05eda7e34a73] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:40:00.226923 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-368c9ba1-08bf-40b6-ae20-1d7965d096d5 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '590e721135c84df5946147ac7e944fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2322cb784615409bb15a6f49522d3b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:40:00.233568 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-368c9ba1-08bf-40b6-ae20-1d7965d096d5 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] 10.222.0.45 "GET /compute/v2.1/servers/9c18953a-7af3-4d71-97ad-05eda7e34a73" status: 200 len: 1238 microversion: 2.1 time: 0.069448 Jan 21 09:40:00.234104 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 377/753] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:40:00 2022] GET /compute/v2.1/servers/9c18953a-7af3-4d71-97ad-05eda7e34a73 => generated 1238 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:40:01.251355 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-9111c219-077a-4c08-ac95-091038832a7a tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:40:01.252500 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-9111c219-077a-4c08-ac95-091038832a7a tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] [instance: 9c18953a-7af3-4d71-97ad-05eda7e34a73] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:40:01.259596 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-9111c219-077a-4c08-ac95-091038832a7a tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:40:01.260042 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-9111c219-077a-4c08-ac95-091038832a7a tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:40:01.260822 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-9111c219-077a-4c08-ac95-091038832a7a tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:40:01.261277 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-9111c219-077a-4c08-ac95-091038832a7a tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:40:01.321771 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-9111c219-077a-4c08-ac95-091038832a7a tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '590e721135c84df5946147ac7e944fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2322cb784615409bb15a6f49522d3b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:40:01.330699 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-9111c219-077a-4c08-ac95-091038832a7a tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] 10.222.0.45 "GET /compute/v2.1/servers/9c18953a-7af3-4d71-97ad-05eda7e34a73" status: 200 len: 1290 microversion: 2.1 time: 0.082325 Jan 21 09:40:01.331422 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 377/754] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:40:01 2022] GET /compute/v2.1/servers/9c18953a-7af3-4d71-97ad-05eda7e34a73 => generated 1290 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:40:02.354611 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-e915d23e-8687-4531-9407-b7dcc600f0d7 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:40:02.355283 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-e915d23e-8687-4531-9407-b7dcc600f0d7 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] [instance: 9c18953a-7af3-4d71-97ad-05eda7e34a73] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:40:02.365206 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-e915d23e-8687-4531-9407-b7dcc600f0d7 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:40:02.365632 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-e915d23e-8687-4531-9407-b7dcc600f0d7 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:40:02.366722 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-e915d23e-8687-4531-9407-b7dcc600f0d7 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:40:02.367168 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-e915d23e-8687-4531-9407-b7dcc600f0d7 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:40:02.456749 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-e915d23e-8687-4531-9407-b7dcc600f0d7 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '590e721135c84df5946147ac7e944fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2322cb784615409bb15a6f49522d3b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:40:02.464389 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-e915d23e-8687-4531-9407-b7dcc600f0d7 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] 10.222.0.45 "GET /compute/v2.1/servers/9c18953a-7af3-4d71-97ad-05eda7e34a73" status: 200 len: 1296 microversion: 2.1 time: 0.117060 Jan 21 09:40:02.464978 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 378/755] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:40:02 2022] GET /compute/v2.1/servers/9c18953a-7af3-4d71-97ad-05eda7e34a73 => generated 1296 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:40:02.692416 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-a13f65c9-c78b-46e5-a2b6-2a1d0f8d49df tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:40:02.693361 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-a13f65c9-c78b-46e5-a2b6-2a1d0f8d49df tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] [instance: 750f8ae5-b267-4b76-bb13-170071722932] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:40:02.700001 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-a13f65c9-c78b-46e5-a2b6-2a1d0f8d49df tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:40:02.700449 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-a13f65c9-c78b-46e5-a2b6-2a1d0f8d49df tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:40:02.701269 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-a13f65c9-c78b-46e5-a2b6-2a1d0f8d49df tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:40:02.701890 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-a13f65c9-c78b-46e5-a2b6-2a1d0f8d49df tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:40:02.998303 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-a13f65c9-c78b-46e5-a2b6-2a1d0f8d49df tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] 10.222.0.45 "POST /compute/v2.1/servers/750f8ae5-b267-4b76-bb13-170071722932/action" status: 202 len: 0 microversion: 2.1 time: 0.309996 Jan 21 09:40:03.001202 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 378/756] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Jan 21 09:40:02 2022] POST /compute/v2.1/servers/750f8ae5-b267-4b76-bb13-170071722932/action => generated 0 bytes in 312 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 21 09:40:03.008415 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-14af16c8-83f4-464d-96c4-9111349f81f6 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:40:03.009667 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-14af16c8-83f4-464d-96c4-9111349f81f6 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] [instance: 750f8ae5-b267-4b76-bb13-170071722932] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:40:03.016426 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-14af16c8-83f4-464d-96c4-9111349f81f6 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:40:03.017232 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-14af16c8-83f4-464d-96c4-9111349f81f6 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:40:03.018499 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-14af16c8-83f4-464d-96c4-9111349f81f6 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:40:03.019215 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-14af16c8-83f4-464d-96c4-9111349f81f6 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:40:03.290910 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-14af16c8-83f4-464d-96c4-9111349f81f6 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a8838f167743678110ca0a9d5a2484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10ed49573f464cc18794b94fd1c115ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:40:03.299373 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-14af16c8-83f4-464d-96c4-9111349f81f6 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] 10.222.0.45 "GET /compute/v2.1/servers/750f8ae5-b267-4b76-bb13-170071722932" status: 200 len: 1749 microversion: 2.1 time: 0.294713 Jan 21 09:40:03.299957 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 379/757] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:40:03 2022] GET /compute/v2.1/servers/750f8ae5-b267-4b76-bb13-170071722932 => generated 1749 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:40:03.481995 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-e0cf775c-f2e3-411f-ab76-632ad08967b5 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:40:03.483104 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-e0cf775c-f2e3-411f-ab76-632ad08967b5 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] [instance: 9c18953a-7af3-4d71-97ad-05eda7e34a73] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:40:03.492499 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-e0cf775c-f2e3-411f-ab76-632ad08967b5 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:40:03.493366 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-e0cf775c-f2e3-411f-ab76-632ad08967b5 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:40:03.494625 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-e0cf775c-f2e3-411f-ab76-632ad08967b5 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:40:03.495215 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-e0cf775c-f2e3-411f-ab76-632ad08967b5 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:40:03.852607 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-e0cf775c-f2e3-411f-ab76-632ad08967b5 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '590e721135c84df5946147ac7e944fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2322cb784615409bb15a6f49522d3b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:40:03.860062 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-e0cf775c-f2e3-411f-ab76-632ad08967b5 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] 10.222.0.45 "GET /compute/v2.1/servers/9c18953a-7af3-4d71-97ad-05eda7e34a73" status: 200 len: 1364 microversion: 2.1 time: 0.382488 Jan 21 09:40:03.861063 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 379/758] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:40:03 2022] GET /compute/v2.1/servers/9c18953a-7af3-4d71-97ad-05eda7e34a73 => generated 1364 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:40:03.981197 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [req-d8d757d0-2f9e-4c37-8a36-b8ac66b41313 req-a2353f63-f7d1-44a2-be3d-71773549b325 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9c18953a-7af3-4d71-97ad-05eda7e34a73", "tag": "da26baff-2b3f-4d1c-9008-db890c2d77f2"}]} {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:40:03.990645 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 21 09:40:03.990645 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: warnings.warn(msg) Jan 21 09:40:04.001079 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [req-d8d757d0-2f9e-4c37-8a36-b8ac66b41313 req-a2353f63-f7d1-44a2-be3d-71773549b325 service nova] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:40:04.002510 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [req-d8d757d0-2f9e-4c37-8a36-b8ac66b41313 req-a2353f63-f7d1-44a2-be3d-71773549b325 service nova] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:40:04.016116 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.compute.server_external_events [req-d8d757d0-2f9e-4c37-8a36-b8ac66b41313 req-a2353f63-f7d1-44a2-be3d-71773549b325 service nova] Creating event network-changed:da26baff-2b3f-4d1c-9008-db890c2d77f2 for instance 9c18953a-7af3-4d71-97ad-05eda7e34a73 on hv-cinder-80403 Jan 21 09:40:04.023503 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [req-d8d757d0-2f9e-4c37-8a36-b8ac66b41313 req-a2353f63-f7d1-44a2-be3d-71773549b325 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045650 Jan 21 09:40:04.024522 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 380/759] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Jan 21 09:40:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 09:40:04.317605 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-84d01a0e-b8d2-4950-bb01-35789433c910 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:40:04.318321 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-84d01a0e-b8d2-4950-bb01-35789433c910 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] [instance: 750f8ae5-b267-4b76-bb13-170071722932] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:40:04.326400 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-84d01a0e-b8d2-4950-bb01-35789433c910 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:40:04.327364 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-84d01a0e-b8d2-4950-bb01-35789433c910 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:40:04.328763 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-84d01a0e-b8d2-4950-bb01-35789433c910 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:40:04.329561 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-84d01a0e-b8d2-4950-bb01-35789433c910 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:40:04.605290 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-84d01a0e-b8d2-4950-bb01-35789433c910 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a8838f167743678110ca0a9d5a2484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10ed49573f464cc18794b94fd1c115ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:40:04.616572 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-84d01a0e-b8d2-4950-bb01-35789433c910 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] 10.222.0.45 "GET /compute/v2.1/servers/750f8ae5-b267-4b76-bb13-170071722932" status: 200 len: 1749 microversion: 2.1 time: 0.303304 Jan 21 09:40:04.623727 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 380/760] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:40:04 2022] GET /compute/v2.1/servers/750f8ae5-b267-4b76-bb13-170071722932 => generated 1749 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:40:04.878087 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-c51a05eb-3f62-430c-a7f4-c8bb3c9480e4 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:40:04.879213 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-c51a05eb-3f62-430c-a7f4-c8bb3c9480e4 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] [instance: 9c18953a-7af3-4d71-97ad-05eda7e34a73] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:40:04.885708 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-c51a05eb-3f62-430c-a7f4-c8bb3c9480e4 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:40:04.886154 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-c51a05eb-3f62-430c-a7f4-c8bb3c9480e4 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:40:04.887196 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-c51a05eb-3f62-430c-a7f4-c8bb3c9480e4 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:40:04.887794 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-c51a05eb-3f62-430c-a7f4-c8bb3c9480e4 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:40:05.088007 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-c51a05eb-3f62-430c-a7f4-c8bb3c9480e4 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '590e721135c84df5946147ac7e944fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2322cb784615409bb15a6f49522d3b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:40:05.097449 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-c51a05eb-3f62-430c-a7f4-c8bb3c9480e4 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] 10.222.0.45 "GET /compute/v2.1/servers/9c18953a-7af3-4d71-97ad-05eda7e34a73" status: 200 len: 1364 microversion: 2.1 time: 0.224406 Jan 21 09:40:05.098226 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 381/761] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:40:04 2022] GET /compute/v2.1/servers/9c18953a-7af3-4d71-97ad-05eda7e34a73 => generated 1364 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:40:05.634196 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-8f3eb25e-d45c-4861-b3be-4c76052e55f2 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:40:05.634893 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-8f3eb25e-d45c-4861-b3be-4c76052e55f2 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] [instance: 750f8ae5-b267-4b76-bb13-170071722932] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:40:05.641717 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-8f3eb25e-d45c-4861-b3be-4c76052e55f2 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:40:05.642182 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-8f3eb25e-d45c-4861-b3be-4c76052e55f2 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:40:05.643515 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-8f3eb25e-d45c-4861-b3be-4c76052e55f2 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:40:05.643946 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-8f3eb25e-d45c-4861-b3be-4c76052e55f2 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:40:05.825962 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-8f3eb25e-d45c-4861-b3be-4c76052e55f2 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a8838f167743678110ca0a9d5a2484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10ed49573f464cc18794b94fd1c115ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:40:05.834513 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-8f3eb25e-d45c-4861-b3be-4c76052e55f2 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] 10.222.0.45 "GET /compute/v2.1/servers/750f8ae5-b267-4b76-bb13-170071722932" status: 200 len: 1754 microversion: 2.1 time: 0.203911 Jan 21 09:40:05.835017 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 381/762] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:40:05 2022] GET /compute/v2.1/servers/750f8ae5-b267-4b76-bb13-170071722932 => generated 1754 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 09:40:06.117372 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-ba3806dd-d1a2-4598-ae02-0eec4984fe09 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:40:06.118111 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-ba3806dd-d1a2-4598-ae02-0eec4984fe09 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] [instance: 9c18953a-7af3-4d71-97ad-05eda7e34a73] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:40:06.126958 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-ba3806dd-d1a2-4598-ae02-0eec4984fe09 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:40:06.127556 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-ba3806dd-d1a2-4598-ae02-0eec4984fe09 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:40:06.128397 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-ba3806dd-d1a2-4598-ae02-0eec4984fe09 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:40:06.128835 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-ba3806dd-d1a2-4598-ae02-0eec4984fe09 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:40:06.317313 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-ba3806dd-d1a2-4598-ae02-0eec4984fe09 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '590e721135c84df5946147ac7e944fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2322cb784615409bb15a6f49522d3b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:40:06.329166 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-ba3806dd-d1a2-4598-ae02-0eec4984fe09 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] 10.222.0.45 "GET /compute/v2.1/servers/9c18953a-7af3-4d71-97ad-05eda7e34a73" status: 200 len: 1364 microversion: 2.1 time: 0.218959 Jan 21 09:40:06.333780 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 382/763] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:40:06 2022] GET /compute/v2.1/servers/9c18953a-7af3-4d71-97ad-05eda7e34a73 => generated 1364 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:40:06.852255 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-9a854a9a-d766-4c01-85fa-0ec5848996b9 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:40:06.852916 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-9a854a9a-d766-4c01-85fa-0ec5848996b9 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] [instance: 750f8ae5-b267-4b76-bb13-170071722932] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:40:06.859302 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-9a854a9a-d766-4c01-85fa-0ec5848996b9 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:40:06.859750 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-9a854a9a-d766-4c01-85fa-0ec5848996b9 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:40:06.860799 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-9a854a9a-d766-4c01-85fa-0ec5848996b9 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:40:06.861308 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-9a854a9a-d766-4c01-85fa-0ec5848996b9 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:40:07.008466 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-9a854a9a-d766-4c01-85fa-0ec5848996b9 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a8838f167743678110ca0a9d5a2484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10ed49573f464cc18794b94fd1c115ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:40:07.016448 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-9a854a9a-d766-4c01-85fa-0ec5848996b9 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] 10.222.0.45 "GET /compute/v2.1/servers/750f8ae5-b267-4b76-bb13-170071722932" status: 200 len: 1754 microversion: 2.1 time: 0.168017 Jan 21 09:40:07.017098 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 382/764] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:40:06 2022] GET /compute/v2.1/servers/750f8ae5-b267-4b76-bb13-170071722932 => generated 1754 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:40:07.348571 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-c8d12954-791d-497f-b91f-c3402ec92a24 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:40:07.349253 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-c8d12954-791d-497f-b91f-c3402ec92a24 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] [instance: 9c18953a-7af3-4d71-97ad-05eda7e34a73] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:40:07.355904 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-c8d12954-791d-497f-b91f-c3402ec92a24 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:40:07.356353 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-c8d12954-791d-497f-b91f-c3402ec92a24 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:40:07.357169 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-c8d12954-791d-497f-b91f-c3402ec92a24 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:40:07.357618 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-c8d12954-791d-497f-b91f-c3402ec92a24 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:40:07.515186 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-c8d12954-791d-497f-b91f-c3402ec92a24 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '590e721135c84df5946147ac7e944fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2322cb784615409bb15a6f49522d3b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:40:07.523275 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-c8d12954-791d-497f-b91f-c3402ec92a24 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] 10.222.0.45 "GET /compute/v2.1/servers/9c18953a-7af3-4d71-97ad-05eda7e34a73" status: 200 len: 1364 microversion: 2.1 time: 0.178687 Jan 21 09:40:07.524069 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 383/765] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:40:07 2022] GET /compute/v2.1/servers/9c18953a-7af3-4d71-97ad-05eda7e34a73 => generated 1364 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:40:08.034207 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-95188a8d-2b44-4f8b-874c-bded6c24ea9a tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:40:08.034798 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-95188a8d-2b44-4f8b-874c-bded6c24ea9a tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] [instance: 750f8ae5-b267-4b76-bb13-170071722932] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:40:08.041000 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-95188a8d-2b44-4f8b-874c-bded6c24ea9a tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:40:08.041482 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-95188a8d-2b44-4f8b-874c-bded6c24ea9a tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:40:08.042311 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-95188a8d-2b44-4f8b-874c-bded6c24ea9a tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:40:08.042751 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-95188a8d-2b44-4f8b-874c-bded6c24ea9a tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:40:08.191422 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-95188a8d-2b44-4f8b-874c-bded6c24ea9a tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a8838f167743678110ca0a9d5a2484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10ed49573f464cc18794b94fd1c115ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:40:08.199444 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-95188a8d-2b44-4f8b-874c-bded6c24ea9a tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] 10.222.0.45 "GET /compute/v2.1/servers/750f8ae5-b267-4b76-bb13-170071722932" status: 200 len: 1754 microversion: 2.1 time: 0.169005 Jan 21 09:40:08.200014 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 383/766] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:40:08 2022] GET /compute/v2.1/servers/750f8ae5-b267-4b76-bb13-170071722932 => generated 1754 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:40:08.541460 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-c5f10494-7aa8-4bc9-8860-e249c293bdbf tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:40:08.542119 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-c5f10494-7aa8-4bc9-8860-e249c293bdbf tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] [instance: 9c18953a-7af3-4d71-97ad-05eda7e34a73] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:40:08.549064 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-c5f10494-7aa8-4bc9-8860-e249c293bdbf tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:40:08.549543 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-c5f10494-7aa8-4bc9-8860-e249c293bdbf tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:40:08.550481 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-c5f10494-7aa8-4bc9-8860-e249c293bdbf tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:40:08.550786 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-c5f10494-7aa8-4bc9-8860-e249c293bdbf tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:40:08.697015 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-c5f10494-7aa8-4bc9-8860-e249c293bdbf tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '590e721135c84df5946147ac7e944fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2322cb784615409bb15a6f49522d3b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:40:08.704281 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-c5f10494-7aa8-4bc9-8860-e249c293bdbf tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] 10.222.0.45 "GET /compute/v2.1/servers/9c18953a-7af3-4d71-97ad-05eda7e34a73" status: 200 len: 1364 microversion: 2.1 time: 0.166603 Jan 21 09:40:08.705483 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 384/767] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:40:08 2022] GET /compute/v2.1/servers/9c18953a-7af3-4d71-97ad-05eda7e34a73 => generated 1364 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:40:09.216481 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-caa446c4-a3aa-4b5f-8ebf-ed921f35497b tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:40:09.217048 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-caa446c4-a3aa-4b5f-8ebf-ed921f35497b tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] [instance: 750f8ae5-b267-4b76-bb13-170071722932] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:40:09.223015 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-caa446c4-a3aa-4b5f-8ebf-ed921f35497b tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:40:09.223464 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-caa446c4-a3aa-4b5f-8ebf-ed921f35497b tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:40:09.224243 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-caa446c4-a3aa-4b5f-8ebf-ed921f35497b tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:40:09.224679 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-caa446c4-a3aa-4b5f-8ebf-ed921f35497b tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:40:09.377528 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-caa446c4-a3aa-4b5f-8ebf-ed921f35497b tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a8838f167743678110ca0a9d5a2484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10ed49573f464cc18794b94fd1c115ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:40:09.384855 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-caa446c4-a3aa-4b5f-8ebf-ed921f35497b tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] 10.222.0.45 "GET /compute/v2.1/servers/750f8ae5-b267-4b76-bb13-170071722932" status: 200 len: 1754 microversion: 2.1 time: 0.172223 Jan 21 09:40:09.385622 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 384/768] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:40:09 2022] GET /compute/v2.1/servers/750f8ae5-b267-4b76-bb13-170071722932 => generated 1754 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:40:09.721558 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-7aad1f78-640c-470e-9339-8324f9246dc4 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:40:09.722236 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-7aad1f78-640c-470e-9339-8324f9246dc4 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] [instance: 9c18953a-7af3-4d71-97ad-05eda7e34a73] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:40:09.728323 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-7aad1f78-640c-470e-9339-8324f9246dc4 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:40:09.728770 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-7aad1f78-640c-470e-9339-8324f9246dc4 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:40:09.729672 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-7aad1f78-640c-470e-9339-8324f9246dc4 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:40:09.730113 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-7aad1f78-640c-470e-9339-8324f9246dc4 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:40:09.873363 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-7aad1f78-640c-470e-9339-8324f9246dc4 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '590e721135c84df5946147ac7e944fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2322cb784615409bb15a6f49522d3b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:40:09.881413 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-7aad1f78-640c-470e-9339-8324f9246dc4 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] 10.222.0.45 "GET /compute/v2.1/servers/9c18953a-7af3-4d71-97ad-05eda7e34a73" status: 200 len: 1364 microversion: 2.1 time: 0.163656 Jan 21 09:40:09.882045 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 385/769] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:40:09 2022] GET /compute/v2.1/servers/9c18953a-7af3-4d71-97ad-05eda7e34a73 => generated 1364 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:40:10.403464 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-95312d2c-abc3-47ad-8df6-288ec660a8bd tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:40:10.404056 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-95312d2c-abc3-47ad-8df6-288ec660a8bd tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] [instance: 750f8ae5-b267-4b76-bb13-170071722932] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:40:10.410328 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-95312d2c-abc3-47ad-8df6-288ec660a8bd tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:40:10.410770 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-95312d2c-abc3-47ad-8df6-288ec660a8bd tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:40:10.411590 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-95312d2c-abc3-47ad-8df6-288ec660a8bd tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:40:10.412017 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-95312d2c-abc3-47ad-8df6-288ec660a8bd tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:40:10.566725 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-95312d2c-abc3-47ad-8df6-288ec660a8bd tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a8838f167743678110ca0a9d5a2484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10ed49573f464cc18794b94fd1c115ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:40:10.574800 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-95312d2c-abc3-47ad-8df6-288ec660a8bd tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] 10.222.0.45 "GET /compute/v2.1/servers/750f8ae5-b267-4b76-bb13-170071722932" status: 200 len: 1754 microversion: 2.1 time: 0.175034 Jan 21 09:40:10.575369 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 385/770] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:40:10 2022] GET /compute/v2.1/servers/750f8ae5-b267-4b76-bb13-170071722932 => generated 1754 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:40:10.898645 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-3c12b259-a017-43c3-80b8-9cf4c87c265a tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:40:10.899270 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-3c12b259-a017-43c3-80b8-9cf4c87c265a tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] [instance: 9c18953a-7af3-4d71-97ad-05eda7e34a73] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:40:10.905224 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-3c12b259-a017-43c3-80b8-9cf4c87c265a tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:40:10.905670 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-3c12b259-a017-43c3-80b8-9cf4c87c265a tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:40:10.906589 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-3c12b259-a017-43c3-80b8-9cf4c87c265a tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:40:10.907104 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-3c12b259-a017-43c3-80b8-9cf4c87c265a tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:40:11.034245 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-3c12b259-a017-43c3-80b8-9cf4c87c265a tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '590e721135c84df5946147ac7e944fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2322cb784615409bb15a6f49522d3b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:40:11.041438 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-3c12b259-a017-43c3-80b8-9cf4c87c265a tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] 10.222.0.45 "GET /compute/v2.1/servers/9c18953a-7af3-4d71-97ad-05eda7e34a73" status: 200 len: 1364 microversion: 2.1 time: 0.146377 Jan 21 09:40:11.042006 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 386/771] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:40:10 2022] GET /compute/v2.1/servers/9c18953a-7af3-4d71-97ad-05eda7e34a73 => generated 1364 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:40:11.592193 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-1d7af1a6-0dad-4907-a798-5d18c8894b97 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:40:11.592839 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-1d7af1a6-0dad-4907-a798-5d18c8894b97 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] [instance: 750f8ae5-b267-4b76-bb13-170071722932] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:40:11.599854 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-1d7af1a6-0dad-4907-a798-5d18c8894b97 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:40:11.600407 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-1d7af1a6-0dad-4907-a798-5d18c8894b97 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:40:11.601209 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-1d7af1a6-0dad-4907-a798-5d18c8894b97 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:40:11.601641 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-1d7af1a6-0dad-4907-a798-5d18c8894b97 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:40:11.758749 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-1d7af1a6-0dad-4907-a798-5d18c8894b97 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a8838f167743678110ca0a9d5a2484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10ed49573f464cc18794b94fd1c115ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:40:11.767065 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-1d7af1a6-0dad-4907-a798-5d18c8894b97 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] 10.222.0.45 "GET /compute/v2.1/servers/750f8ae5-b267-4b76-bb13-170071722932" status: 200 len: 1754 microversion: 2.1 time: 0.178441 Jan 21 09:40:11.768396 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 386/772] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:40:11 2022] GET /compute/v2.1/servers/750f8ae5-b267-4b76-bb13-170071722932 => generated 1754 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:40:12.060475 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-23276a17-dd55-4fbe-8306-b9e504792738 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:40:12.061044 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-23276a17-dd55-4fbe-8306-b9e504792738 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] [instance: 9c18953a-7af3-4d71-97ad-05eda7e34a73] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:40:12.068479 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-23276a17-dd55-4fbe-8306-b9e504792738 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:40:12.068928 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-23276a17-dd55-4fbe-8306-b9e504792738 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:40:12.069750 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-23276a17-dd55-4fbe-8306-b9e504792738 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:40:12.070186 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-23276a17-dd55-4fbe-8306-b9e504792738 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:40:12.228968 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-23276a17-dd55-4fbe-8306-b9e504792738 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '590e721135c84df5946147ac7e944fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2322cb784615409bb15a6f49522d3b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:40:12.237637 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-23276a17-dd55-4fbe-8306-b9e504792738 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] 10.222.0.45 "GET /compute/v2.1/servers/9c18953a-7af3-4d71-97ad-05eda7e34a73" status: 200 len: 1364 microversion: 2.1 time: 0.181537 Jan 21 09:40:12.238228 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 387/773] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:40:12 2022] GET /compute/v2.1/servers/9c18953a-7af3-4d71-97ad-05eda7e34a73 => generated 1364 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:40:12.785556 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-4c0588d3-7f3b-4c57-bb23-da8d666ed33d tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:40:12.786173 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-4c0588d3-7f3b-4c57-bb23-da8d666ed33d tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] [instance: 750f8ae5-b267-4b76-bb13-170071722932] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:40:12.792393 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-4c0588d3-7f3b-4c57-bb23-da8d666ed33d tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:40:12.792839 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-4c0588d3-7f3b-4c57-bb23-da8d666ed33d tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:40:12.793751 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-4c0588d3-7f3b-4c57-bb23-da8d666ed33d tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:40:12.794100 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-4c0588d3-7f3b-4c57-bb23-da8d666ed33d tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:40:12.940059 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-4c0588d3-7f3b-4c57-bb23-da8d666ed33d tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a8838f167743678110ca0a9d5a2484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10ed49573f464cc18794b94fd1c115ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:40:12.947886 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-4c0588d3-7f3b-4c57-bb23-da8d666ed33d tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] 10.222.0.45 "GET /compute/v2.1/servers/750f8ae5-b267-4b76-bb13-170071722932" status: 200 len: 1754 microversion: 2.1 time: 0.166628 Jan 21 09:40:12.948458 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 387/774] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:40:12 2022] GET /compute/v2.1/servers/750f8ae5-b267-4b76-bb13-170071722932 => generated 1754 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:40:13.256738 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-df28138f-a4ca-4e91-adc1-3cb9ec11efc4 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:40:13.257749 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-df28138f-a4ca-4e91-adc1-3cb9ec11efc4 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] [instance: 9c18953a-7af3-4d71-97ad-05eda7e34a73] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:40:13.266644 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-df28138f-a4ca-4e91-adc1-3cb9ec11efc4 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:40:13.267151 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-df28138f-a4ca-4e91-adc1-3cb9ec11efc4 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:40:13.268588 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-df28138f-a4ca-4e91-adc1-3cb9ec11efc4 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:40:13.269937 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-df28138f-a4ca-4e91-adc1-3cb9ec11efc4 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:40:13.447265 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-df28138f-a4ca-4e91-adc1-3cb9ec11efc4 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '590e721135c84df5946147ac7e944fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2322cb784615409bb15a6f49522d3b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:40:13.447265 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-df28138f-a4ca-4e91-adc1-3cb9ec11efc4 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] 10.222.0.45 "GET /compute/v2.1/servers/9c18953a-7af3-4d71-97ad-05eda7e34a73" status: 200 len: 1364 microversion: 2.1 time: 0.191400 Jan 21 09:40:13.447265 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 388/775] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:40:13 2022] GET /compute/v2.1/servers/9c18953a-7af3-4d71-97ad-05eda7e34a73 => generated 1364 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:40:13.965938 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-3ae74044-c3ec-46fb-b9fc-2eec8580b8ec tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:40:13.971888 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-3ae74044-c3ec-46fb-b9fc-2eec8580b8ec tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] [instance: 750f8ae5-b267-4b76-bb13-170071722932] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:40:13.974406 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-3ae74044-c3ec-46fb-b9fc-2eec8580b8ec tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:40:13.974862 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-3ae74044-c3ec-46fb-b9fc-2eec8580b8ec tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:40:13.975648 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-3ae74044-c3ec-46fb-b9fc-2eec8580b8ec tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:40:13.976083 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-3ae74044-c3ec-46fb-b9fc-2eec8580b8ec tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:40:14.122504 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-3ae74044-c3ec-46fb-b9fc-2eec8580b8ec tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a8838f167743678110ca0a9d5a2484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10ed49573f464cc18794b94fd1c115ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:40:14.132517 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-3ae74044-c3ec-46fb-b9fc-2eec8580b8ec tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] 10.222.0.45 "GET /compute/v2.1/servers/750f8ae5-b267-4b76-bb13-170071722932" status: 200 len: 1754 microversion: 2.1 time: 0.169347 Jan 21 09:40:14.136462 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 388/776] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:40:13 2022] GET /compute/v2.1/servers/750f8ae5-b267-4b76-bb13-170071722932 => generated 1754 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:40:14.461545 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-0c9d248b-b39d-412c-928e-75a8cfce06ee tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:40:14.462184 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-0c9d248b-b39d-412c-928e-75a8cfce06ee tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] [instance: 9c18953a-7af3-4d71-97ad-05eda7e34a73] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:40:14.468733 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-0c9d248b-b39d-412c-928e-75a8cfce06ee tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:40:14.469412 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-0c9d248b-b39d-412c-928e-75a8cfce06ee tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:40:14.471328 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-0c9d248b-b39d-412c-928e-75a8cfce06ee tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:40:14.472264 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-0c9d248b-b39d-412c-928e-75a8cfce06ee tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:40:14.718033 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-0c9d248b-b39d-412c-928e-75a8cfce06ee tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '590e721135c84df5946147ac7e944fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2322cb784615409bb15a6f49522d3b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:40:14.725495 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-0c9d248b-b39d-412c-928e-75a8cfce06ee tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] 10.222.0.45 "GET /compute/v2.1/servers/9c18953a-7af3-4d71-97ad-05eda7e34a73" status: 200 len: 1364 microversion: 2.1 time: 0.269103 Jan 21 09:40:14.726277 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 389/777] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:40:14 2022] GET /compute/v2.1/servers/9c18953a-7af3-4d71-97ad-05eda7e34a73 => generated 1364 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:40:15.156004 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-3b84fb4a-f83c-4f5c-8ba6-dd95e87cfef7 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:40:15.156670 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-3b84fb4a-f83c-4f5c-8ba6-dd95e87cfef7 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] [instance: 750f8ae5-b267-4b76-bb13-170071722932] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:40:15.163215 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-3b84fb4a-f83c-4f5c-8ba6-dd95e87cfef7 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:40:15.163668 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-3b84fb4a-f83c-4f5c-8ba6-dd95e87cfef7 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:40:15.164467 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-3b84fb4a-f83c-4f5c-8ba6-dd95e87cfef7 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:40:15.164976 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-3b84fb4a-f83c-4f5c-8ba6-dd95e87cfef7 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:40:15.372090 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-3b84fb4a-f83c-4f5c-8ba6-dd95e87cfef7 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a8838f167743678110ca0a9d5a2484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10ed49573f464cc18794b94fd1c115ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:40:15.388385 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-3b84fb4a-f83c-4f5c-8ba6-dd95e87cfef7 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] 10.222.0.45 "GET /compute/v2.1/servers/750f8ae5-b267-4b76-bb13-170071722932" status: 200 len: 1754 microversion: 2.1 time: 0.236504 Jan 21 09:40:15.403049 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 389/778] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:40:15 2022] GET /compute/v2.1/servers/750f8ae5-b267-4b76-bb13-170071722932 => generated 1754 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:40:15.414949 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [req-59eb02a2-e521-40cc-b157-e30fb55f8296 req-17b6ef1e-c666-4f9e-a457-4c1e65f5ab38 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c18953a-7af3-4d71-97ad-05eda7e34a73", "name": "network-vif-plugged", "status": "completed", "tag": "da26baff-2b3f-4d1c-9008-db890c2d77f2"}]} {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:40:15.417544 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 21 09:40:15.417544 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: warnings.warn(msg) Jan 21 09:40:15.427661 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [req-59eb02a2-e521-40cc-b157-e30fb55f8296 req-17b6ef1e-c666-4f9e-a457-4c1e65f5ab38 service nova] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:40:15.428393 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [req-59eb02a2-e521-40cc-b157-e30fb55f8296 req-17b6ef1e-c666-4f9e-a457-4c1e65f5ab38 service nova] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:40:15.441206 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.compute.server_external_events [req-59eb02a2-e521-40cc-b157-e30fb55f8296 req-17b6ef1e-c666-4f9e-a457-4c1e65f5ab38 service nova] Creating event network-vif-plugged:da26baff-2b3f-4d1c-9008-db890c2d77f2 for instance 9c18953a-7af3-4d71-97ad-05eda7e34a73 on hv-cinder-80403 Jan 21 09:40:15.446351 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [req-59eb02a2-e521-40cc-b157-e30fb55f8296 req-17b6ef1e-c666-4f9e-a457-4c1e65f5ab38 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036464 Jan 21 09:40:15.446952 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 390/779] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Jan 21 09:40:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 09:40:15.742968 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-709ffa35-039c-48b2-813d-95e54952db7a tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:40:15.743795 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-709ffa35-039c-48b2-813d-95e54952db7a tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] [instance: 9c18953a-7af3-4d71-97ad-05eda7e34a73] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:40:15.750652 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-709ffa35-039c-48b2-813d-95e54952db7a tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:40:15.756497 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-709ffa35-039c-48b2-813d-95e54952db7a tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:40:15.756497 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-709ffa35-039c-48b2-813d-95e54952db7a tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:40:15.756497 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-709ffa35-039c-48b2-813d-95e54952db7a tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:40:15.943651 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-709ffa35-039c-48b2-813d-95e54952db7a tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '590e721135c84df5946147ac7e944fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2322cb784615409bb15a6f49522d3b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:40:15.951229 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-709ffa35-039c-48b2-813d-95e54952db7a tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] 10.222.0.45 "GET /compute/v2.1/servers/9c18953a-7af3-4d71-97ad-05eda7e34a73" status: 200 len: 1364 microversion: 2.1 time: 0.211787 Jan 21 09:40:15.951809 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 390/780] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:40:15 2022] GET /compute/v2.1/servers/9c18953a-7af3-4d71-97ad-05eda7e34a73 => generated 1364 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:40:16.407792 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-0ad80b5c-2982-4edc-b663-a67d22cecd10 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:40:16.408502 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-0ad80b5c-2982-4edc-b663-a67d22cecd10 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] [instance: 750f8ae5-b267-4b76-bb13-170071722932] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:40:16.415171 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-0ad80b5c-2982-4edc-b663-a67d22cecd10 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:40:16.415621 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-0ad80b5c-2982-4edc-b663-a67d22cecd10 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:40:16.416414 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-0ad80b5c-2982-4edc-b663-a67d22cecd10 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:40:16.416857 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-0ad80b5c-2982-4edc-b663-a67d22cecd10 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:40:16.842906 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-0ad80b5c-2982-4edc-b663-a67d22cecd10 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a8838f167743678110ca0a9d5a2484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10ed49573f464cc18794b94fd1c115ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:40:16.853075 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-0ad80b5c-2982-4edc-b663-a67d22cecd10 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] 10.222.0.45 "GET /compute/v2.1/servers/750f8ae5-b267-4b76-bb13-170071722932" status: 200 len: 1754 microversion: 2.1 time: 0.449617 Jan 21 09:40:16.863423 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 391/781] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:40:16 2022] GET /compute/v2.1/servers/750f8ae5-b267-4b76-bb13-170071722932 => generated 1754 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:40:16.968767 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-70337a0e-de5c-46d9-995f-21969d4fdca2 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:40:16.969629 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-70337a0e-de5c-46d9-995f-21969d4fdca2 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] [instance: 9c18953a-7af3-4d71-97ad-05eda7e34a73] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:40:16.994800 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-70337a0e-de5c-46d9-995f-21969d4fdca2 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:40:16.995380 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-70337a0e-de5c-46d9-995f-21969d4fdca2 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:40:16.996335 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-70337a0e-de5c-46d9-995f-21969d4fdca2 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:40:16.996926 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-70337a0e-de5c-46d9-995f-21969d4fdca2 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:40:17.167865 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-70337a0e-de5c-46d9-995f-21969d4fdca2 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '590e721135c84df5946147ac7e944fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2322cb784615409bb15a6f49522d3b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:40:17.176721 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-70337a0e-de5c-46d9-995f-21969d4fdca2 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] 10.222.0.45 "GET /compute/v2.1/servers/9c18953a-7af3-4d71-97ad-05eda7e34a73" status: 200 len: 1364 microversion: 2.1 time: 0.211479 Jan 21 09:40:17.177605 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 391/782] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:40:16 2022] GET /compute/v2.1/servers/9c18953a-7af3-4d71-97ad-05eda7e34a73 => generated 1364 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:40:17.870337 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-6882898d-6979-42f8-b42f-32e2aa9e8ec5 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:40:17.870878 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-6882898d-6979-42f8-b42f-32e2aa9e8ec5 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] [instance: 750f8ae5-b267-4b76-bb13-170071722932] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:40:17.878131 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-6882898d-6979-42f8-b42f-32e2aa9e8ec5 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:40:17.878615 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-6882898d-6979-42f8-b42f-32e2aa9e8ec5 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:40:17.879493 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-6882898d-6979-42f8-b42f-32e2aa9e8ec5 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:40:17.879853 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-6882898d-6979-42f8-b42f-32e2aa9e8ec5 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:40:18.059805 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-6882898d-6979-42f8-b42f-32e2aa9e8ec5 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a8838f167743678110ca0a9d5a2484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10ed49573f464cc18794b94fd1c115ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:40:18.068785 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-6882898d-6979-42f8-b42f-32e2aa9e8ec5 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] 10.222.0.45 "GET /compute/v2.1/servers/750f8ae5-b267-4b76-bb13-170071722932" status: 200 len: 1754 microversion: 2.1 time: 0.202147 Jan 21 09:40:18.069394 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 392/783] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:40:17 2022] GET /compute/v2.1/servers/750f8ae5-b267-4b76-bb13-170071722932 => generated 1754 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:40:18.195823 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-bee1afbd-0da6-42bc-bed9-b1c5ab6288af tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:40:18.196613 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-bee1afbd-0da6-42bc-bed9-b1c5ab6288af tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] [instance: 9c18953a-7af3-4d71-97ad-05eda7e34a73] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:40:18.202631 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-bee1afbd-0da6-42bc-bed9-b1c5ab6288af tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:40:18.203145 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-bee1afbd-0da6-42bc-bed9-b1c5ab6288af tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:40:18.203953 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-bee1afbd-0da6-42bc-bed9-b1c5ab6288af tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:40:18.204398 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-bee1afbd-0da6-42bc-bed9-b1c5ab6288af tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:40:18.357502 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-bee1afbd-0da6-42bc-bed9-b1c5ab6288af tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '590e721135c84df5946147ac7e944fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2322cb784615409bb15a6f49522d3b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:40:18.365716 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-bee1afbd-0da6-42bc-bed9-b1c5ab6288af tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] 10.222.0.45 "GET /compute/v2.1/servers/9c18953a-7af3-4d71-97ad-05eda7e34a73" status: 200 len: 1551 microversion: 2.1 time: 0.173261 Jan 21 09:40:18.366299 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 392/784] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:40:18 2022] GET /compute/v2.1/servers/9c18953a-7af3-4d71-97ad-05eda7e34a73 => generated 1551 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:40:18.391257 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-b59791dc-3cae-4482-9127-729df6eb5acc tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:40:18.391844 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-b59791dc-3cae-4482-9127-729df6eb5acc tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] [instance: 9c18953a-7af3-4d71-97ad-05eda7e34a73] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:40:18.398906 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-b59791dc-3cae-4482-9127-729df6eb5acc tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:40:18.399372 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-b59791dc-3cae-4482-9127-729df6eb5acc tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:40:18.401950 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-b59791dc-3cae-4482-9127-729df6eb5acc tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:40:18.402629 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-b59791dc-3cae-4482-9127-729df6eb5acc tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:40:18.488138 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-b59791dc-3cae-4482-9127-729df6eb5acc tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] 10.222.0.45 "GET /compute/v2.1/servers/9c18953a-7af3-4d71-97ad-05eda7e34a73/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.100756 Jan 21 09:40:18.489183 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 393/785] 10.222.0.45 () {58 vars in 1274 bytes} [Fri Jan 21 09:40:18 2022] GET /compute/v2.1/servers/9c18953a-7af3-4d71-97ad-05eda7e34a73/os-interface => generated 285 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 09:40:19.087223 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-275be3b0-0a71-422b-8151-70892a667c13 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:40:19.087926 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-275be3b0-0a71-422b-8151-70892a667c13 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] [instance: 750f8ae5-b267-4b76-bb13-170071722932] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:40:19.094552 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-275be3b0-0a71-422b-8151-70892a667c13 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:40:19.095017 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-275be3b0-0a71-422b-8151-70892a667c13 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:40:19.096567 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-275be3b0-0a71-422b-8151-70892a667c13 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:40:19.098150 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-275be3b0-0a71-422b-8151-70892a667c13 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:40:19.273358 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-275be3b0-0a71-422b-8151-70892a667c13 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a8838f167743678110ca0a9d5a2484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10ed49573f464cc18794b94fd1c115ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:40:19.283249 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-275be3b0-0a71-422b-8151-70892a667c13 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] 10.222.0.45 "GET /compute/v2.1/servers/750f8ae5-b267-4b76-bb13-170071722932" status: 200 len: 1754 microversion: 2.1 time: 0.199275 Jan 21 09:40:19.284143 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 393/786] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:40:19 2022] GET /compute/v2.1/servers/750f8ae5-b267-4b76-bb13-170071722932 => generated 1754 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:40:20.190001 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-6b22c11a-ad43-4fcf-9bf6-763b64ce349b tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:40:20.191130 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-6b22c11a-ad43-4fcf-9bf6-763b64ce349b tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] [instance: 9c18953a-7af3-4d71-97ad-05eda7e34a73] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:40:20.195152 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [req-098625f7-0cf4-4a56-b8d8-8f496ea0b4a1 req-63839139-73f4-458f-83f5-556b73d038cd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9c18953a-7af3-4d71-97ad-05eda7e34a73", "tag": "da26baff-2b3f-4d1c-9008-db890c2d77f2"}]} {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:40:20.196816 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 21 09:40:20.196816 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: warnings.warn(msg) Jan 21 09:40:20.201967 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-6b22c11a-ad43-4fcf-9bf6-763b64ce349b tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:40:20.201967 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-6b22c11a-ad43-4fcf-9bf6-763b64ce349b tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:40:20.201967 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-6b22c11a-ad43-4fcf-9bf6-763b64ce349b tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:40:20.202433 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-6b22c11a-ad43-4fcf-9bf6-763b64ce349b tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:40:20.210957 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [req-098625f7-0cf4-4a56-b8d8-8f496ea0b4a1 req-63839139-73f4-458f-83f5-556b73d038cd service nova] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:40:20.211406 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [req-098625f7-0cf4-4a56-b8d8-8f496ea0b4a1 req-63839139-73f4-458f-83f5-556b73d038cd service nova] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:40:20.225056 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.compute.server_external_events [req-098625f7-0cf4-4a56-b8d8-8f496ea0b4a1 req-63839139-73f4-458f-83f5-556b73d038cd service nova] Creating event network-changed:da26baff-2b3f-4d1c-9008-db890c2d77f2 for instance 9c18953a-7af3-4d71-97ad-05eda7e34a73 on hv-cinder-80403 Jan 21 09:40:20.231812 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [req-098625f7-0cf4-4a56-b8d8-8f496ea0b4a1 req-63839139-73f4-458f-83f5-556b73d038cd service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038773 Jan 21 09:40:20.233053 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 394/787] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Jan 21 09:40:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 21 09:40:20.301507 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-2c725ba9-4fe1-4ae1-9abf-d2d65ee1db83 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:40:20.302219 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-2c725ba9-4fe1-4ae1-9abf-d2d65ee1db83 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] [instance: 750f8ae5-b267-4b76-bb13-170071722932] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:40:20.309293 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-2c725ba9-4fe1-4ae1-9abf-d2d65ee1db83 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:40:20.309754 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-2c725ba9-4fe1-4ae1-9abf-d2d65ee1db83 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:40:20.310560 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-2c725ba9-4fe1-4ae1-9abf-d2d65ee1db83 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:40:20.311070 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-2c725ba9-4fe1-4ae1-9abf-d2d65ee1db83 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:40:20.486059 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-2c725ba9-4fe1-4ae1-9abf-d2d65ee1db83 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a8838f167743678110ca0a9d5a2484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10ed49573f464cc18794b94fd1c115ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:40:20.499829 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-2c725ba9-4fe1-4ae1-9abf-d2d65ee1db83 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] 10.222.0.45 "GET /compute/v2.1/servers/750f8ae5-b267-4b76-bb13-170071722932" status: 200 len: 1754 microversion: 2.1 time: 0.203355 Jan 21 09:40:20.501579 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 395/788] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:40:20 2022] GET /compute/v2.1/servers/750f8ae5-b267-4b76-bb13-170071722932 => generated 1754 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 09:40:21.523506 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-2350ee5c-73f9-477e-af5b-f2ad57dc2c3d tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:40:21.524160 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-2350ee5c-73f9-477e-af5b-f2ad57dc2c3d tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] [instance: 750f8ae5-b267-4b76-bb13-170071722932] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:40:21.530536 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-2350ee5c-73f9-477e-af5b-f2ad57dc2c3d tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:40:21.530977 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-2350ee5c-73f9-477e-af5b-f2ad57dc2c3d tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:40:21.531749 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-2350ee5c-73f9-477e-af5b-f2ad57dc2c3d tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:40:21.532174 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-2350ee5c-73f9-477e-af5b-f2ad57dc2c3d tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:40:21.698449 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-2350ee5c-73f9-477e-af5b-f2ad57dc2c3d tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a8838f167743678110ca0a9d5a2484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10ed49573f464cc18794b94fd1c115ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:40:21.707135 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-2350ee5c-73f9-477e-af5b-f2ad57dc2c3d tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] 10.222.0.45 "GET /compute/v2.1/servers/750f8ae5-b267-4b76-bb13-170071722932" status: 200 len: 1754 microversion: 2.1 time: 0.187645 Jan 21 09:40:21.707709 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 396/789] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:40:21 2022] GET /compute/v2.1/servers/750f8ae5-b267-4b76-bb13-170071722932 => generated 1754 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 09:40:22.716653 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-6b22c11a-ad43-4fcf-9bf6-763b64ce349b tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] 10.222.0.45 "POST /compute/v2.1/servers/9c18953a-7af3-4d71-97ad-05eda7e34a73/action" status: 200 len: 14 microversion: 2.1 time: 2.531300 Jan 21 09:40:22.719892 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 394/790] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Jan 21 09:40:20 2022] POST /compute/v2.1/servers/9c18953a-7af3-4d71-97ad-05eda7e34a73/action => generated 14 bytes in 2533 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jan 21 09:40:22.724527 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-325dfd01-e3cd-450c-b446-5753af9765c6 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:40:22.725798 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-325dfd01-e3cd-450c-b446-5753af9765c6 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] [instance: 750f8ae5-b267-4b76-bb13-170071722932] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:40:22.732535 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-325dfd01-e3cd-450c-b446-5753af9765c6 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:40:22.732983 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-325dfd01-e3cd-450c-b446-5753af9765c6 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:40:22.733811 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-325dfd01-e3cd-450c-b446-5753af9765c6 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:40:22.734242 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-325dfd01-e3cd-450c-b446-5753af9765c6 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:40:23.002384 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-325dfd01-e3cd-450c-b446-5753af9765c6 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a8838f167743678110ca0a9d5a2484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10ed49573f464cc18794b94fd1c115ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:40:23.010445 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-325dfd01-e3cd-450c-b446-5753af9765c6 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] 10.222.0.45 "GET /compute/v2.1/servers/750f8ae5-b267-4b76-bb13-170071722932" status: 200 len: 1754 microversion: 2.1 time: 0.290549 Jan 21 09:40:23.011033 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 397/791] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:40:22 2022] GET /compute/v2.1/servers/750f8ae5-b267-4b76-bb13-170071722932 => generated 1754 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 09:40:23.727080 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-f14c0b43-0d72-4ab5-abe2-188591409113 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:40:23.728074 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-f14c0b43-0d72-4ab5-abe2-188591409113 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] [instance: 9c18953a-7af3-4d71-97ad-05eda7e34a73] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:40:23.734923 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-f14c0b43-0d72-4ab5-abe2-188591409113 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:40:23.735641 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-f14c0b43-0d72-4ab5-abe2-188591409113 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:40:23.736746 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-f14c0b43-0d72-4ab5-abe2-188591409113 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:40:23.737197 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-f14c0b43-0d72-4ab5-abe2-188591409113 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:40:23.801095 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-f14c0b43-0d72-4ab5-abe2-188591409113 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] 10.222.0.45 "POST /compute/v2.1/servers/9c18953a-7af3-4d71-97ad-05eda7e34a73/action" status: 200 len: 14 microversion: 2.1 time: 0.077851 Jan 21 09:40:23.801907 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 395/792] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Jan 21 09:40:23 2022] POST /compute/v2.1/servers/9c18953a-7af3-4d71-97ad-05eda7e34a73/action => generated 14 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 21 09:40:24.027609 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-38b54296-c233-48f1-bb74-a0e7a0871bac tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:40:24.028218 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-38b54296-c233-48f1-bb74-a0e7a0871bac tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] [instance: 750f8ae5-b267-4b76-bb13-170071722932] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:40:24.034937 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-38b54296-c233-48f1-bb74-a0e7a0871bac tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:40:24.035346 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-38b54296-c233-48f1-bb74-a0e7a0871bac tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:40:24.036159 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-38b54296-c233-48f1-bb74-a0e7a0871bac tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:40:24.036583 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-38b54296-c233-48f1-bb74-a0e7a0871bac tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:40:24.219298 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-38b54296-c233-48f1-bb74-a0e7a0871bac tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a8838f167743678110ca0a9d5a2484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10ed49573f464cc18794b94fd1c115ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:40:24.227609 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-38b54296-c233-48f1-bb74-a0e7a0871bac tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] 10.222.0.45 "GET /compute/v2.1/servers/750f8ae5-b267-4b76-bb13-170071722932" status: 200 len: 1757 microversion: 2.1 time: 0.203641 Jan 21 09:40:24.228288 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 398/793] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:40:24 2022] GET /compute/v2.1/servers/750f8ae5-b267-4b76-bb13-170071722932 => generated 1757 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:40:24.812293 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-d1e605f7-c1be-4282-b556-47ef027e4e7a tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:40:24.813465 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-d1e605f7-c1be-4282-b556-47ef027e4e7a tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] [instance: 9c18953a-7af3-4d71-97ad-05eda7e34a73] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:40:24.821125 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-d1e605f7-c1be-4282-b556-47ef027e4e7a tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:40:24.821593 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-d1e605f7-c1be-4282-b556-47ef027e4e7a tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:40:24.822384 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-d1e605f7-c1be-4282-b556-47ef027e4e7a tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:40:24.822821 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-d1e605f7-c1be-4282-b556-47ef027e4e7a tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:40:27.190785 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-d1e605f7-c1be-4282-b556-47ef027e4e7a tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] 10.222.0.45 "POST /compute/v2.1/servers/9c18953a-7af3-4d71-97ad-05eda7e34a73/action" status: 200 len: 14 microversion: 2.1 time: 2.382187 Jan 21 09:40:27.191469 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 396/794] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Jan 21 09:40:24 2022] POST /compute/v2.1/servers/9c18953a-7af3-4d71-97ad-05eda7e34a73/action => generated 14 bytes in 2384 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 21 09:40:27.456873 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-cc733bd4-3acb-4fc5-8c7a-491220a1cd87 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:40:27.463169 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-cc733bd4-3acb-4fc5-8c7a-491220a1cd87 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] [instance: 59ad64a5-af93-44ef-8031-fd2f2d18a901] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:40:27.464642 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-cc733bd4-3acb-4fc5-8c7a-491220a1cd87 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:40:27.465087 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-cc733bd4-3acb-4fc5-8c7a-491220a1cd87 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:40:27.465895 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-cc733bd4-3acb-4fc5-8c7a-491220a1cd87 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:40:27.466330 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-cc733bd4-3acb-4fc5-8c7a-491220a1cd87 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:40:27.494974 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-cc733bd4-3acb-4fc5-8c7a-491220a1cd87 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "GET /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901/os-volume_attachments/0d05e46e-c117-47fd-a511-eb6143bd8e2d" status: 200 len: 194 microversion: 2.20 time: 0.041917 Jan 21 09:40:27.495556 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 399/795] 10.222.0.45 () {60 vars in 1453 bytes} [Fri Jan 21 09:40:27 2022] GET /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901/os-volume_attachments/0d05e46e-c117-47fd-a511-eb6143bd8e2d => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 21 09:40:27.557202 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-8bcddf28-91fd-4ae3-9171-6742f951f243 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:40:27.557785 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-8bcddf28-91fd-4ae3-9171-6742f951f243 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] [instance: 59ad64a5-af93-44ef-8031-fd2f2d18a901] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:40:27.565439 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-8bcddf28-91fd-4ae3-9171-6742f951f243 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:40:27.567571 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-8bcddf28-91fd-4ae3-9171-6742f951f243 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:40:27.567571 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-8bcddf28-91fd-4ae3-9171-6742f951f243 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:40:27.567807 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-8bcddf28-91fd-4ae3-9171-6742f951f243 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:40:27.654006 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.objects.instance [None req-8bcddf28-91fd-4ae3-9171-6742f951f243 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lazy-loading 'services' on Instance uuid 59ad64a5-af93-44ef-8031-fd2f2d18a901 {{(pid=123386) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 21 09:40:27.895650 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-8bcddf28-91fd-4ae3-9171-6742f951f243 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "DELETE /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901/os-volume_attachments/0d05e46e-c117-47fd-a511-eb6143bd8e2d" status: 202 len: 0 microversion: 2.20 time: 0.342079 Jan 21 09:40:27.896252 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 397/796] 10.222.0.45 () {60 vars in 1456 bytes} [Fri Jan 21 09:40:27 2022] DELETE /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901/os-volume_attachments/0d05e46e-c117-47fd-a511-eb6143bd8e2d => generated 0 bytes in 344 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jan 21 09:40:27.904462 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-776fd7b8-c9b8-4599-b250-dd60f01af3f8 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:40:27.906296 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-776fd7b8-c9b8-4599-b250-dd60f01af3f8 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] [instance: 59ad64a5-af93-44ef-8031-fd2f2d18a901] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:40:27.913356 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-776fd7b8-c9b8-4599-b250-dd60f01af3f8 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:40:27.913800 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-776fd7b8-c9b8-4599-b250-dd60f01af3f8 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:40:27.914627 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-776fd7b8-c9b8-4599-b250-dd60f01af3f8 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:40:27.915061 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-776fd7b8-c9b8-4599-b250-dd60f01af3f8 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:40:27.944471 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-776fd7b8-c9b8-4599-b250-dd60f01af3f8 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "GET /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043685 Jan 21 09:40:27.945069 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 400/797] 10.222.0.45 () {60 vars in 1342 bytes} [Fri Jan 21 09:40:27 2022] GET /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 21 09:40:28.203936 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-0cc565b8-17f6-4323-87ae-203563150998 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:40:28.204999 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-0cc565b8-17f6-4323-87ae-203563150998 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] [instance: 9c18953a-7af3-4d71-97ad-05eda7e34a73] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:40:28.211722 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-0cc565b8-17f6-4323-87ae-203563150998 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:40:28.212172 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-0cc565b8-17f6-4323-87ae-203563150998 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:40:28.212951 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-0cc565b8-17f6-4323-87ae-203563150998 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:40:28.213415 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-0cc565b8-17f6-4323-87ae-203563150998 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:40:28.275905 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-0cc565b8-17f6-4323-87ae-203563150998 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] 10.222.0.45 "POST /compute/v2.1/servers/9c18953a-7af3-4d71-97ad-05eda7e34a73/action" status: 200 len: 14 microversion: 2.1 time: 0.076394 Jan 21 09:40:28.279222 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 398/798] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Jan 21 09:40:28 2022] POST /compute/v2.1/servers/9c18953a-7af3-4d71-97ad-05eda7e34a73/action => generated 14 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 21 09:40:28.955898 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-aa44978a-26fa-4b26-93d0-ef0ff7bd2bda tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:40:28.956791 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-aa44978a-26fa-4b26-93d0-ef0ff7bd2bda tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] [instance: 59ad64a5-af93-44ef-8031-fd2f2d18a901] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:40:28.963751 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-aa44978a-26fa-4b26-93d0-ef0ff7bd2bda tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:40:28.964199 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-aa44978a-26fa-4b26-93d0-ef0ff7bd2bda tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:40:28.965019 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-aa44978a-26fa-4b26-93d0-ef0ff7bd2bda tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:40:28.965514 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-aa44978a-26fa-4b26-93d0-ef0ff7bd2bda tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:40:28.997518 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-aa44978a-26fa-4b26-93d0-ef0ff7bd2bda tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "GET /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045371 Jan 21 09:40:28.998097 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 401/799] 10.222.0.45 () {60 vars in 1342 bytes} [Fri Jan 21 09:40:28 2022] GET /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 21 09:40:29.287303 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-c3b8311f-309b-447a-86fe-bd14723eb361 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:40:29.288298 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-c3b8311f-309b-447a-86fe-bd14723eb361 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] [instance: 9c18953a-7af3-4d71-97ad-05eda7e34a73] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:40:29.295173 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-c3b8311f-309b-447a-86fe-bd14723eb361 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:40:29.295623 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-c3b8311f-309b-447a-86fe-bd14723eb361 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:40:29.296407 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-c3b8311f-309b-447a-86fe-bd14723eb361 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:40:29.296842 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-c3b8311f-309b-447a-86fe-bd14723eb361 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:40:30.010255 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-f80c0194-8345-4338-aa37-097a6da6b6b6 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:40:30.011250 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-f80c0194-8345-4338-aa37-097a6da6b6b6 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] [instance: 59ad64a5-af93-44ef-8031-fd2f2d18a901] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:40:30.017600 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-f80c0194-8345-4338-aa37-097a6da6b6b6 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:40:30.018042 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-f80c0194-8345-4338-aa37-097a6da6b6b6 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:40:30.018809 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-f80c0194-8345-4338-aa37-097a6da6b6b6 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:40:30.019240 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-f80c0194-8345-4338-aa37-097a6da6b6b6 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:40:30.048755 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-f80c0194-8345-4338-aa37-097a6da6b6b6 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "GET /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.042259 Jan 21 09:40:30.049390 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 402/800] 10.222.0.45 () {60 vars in 1342 bytes} [Fri Jan 21 09:40:30 2022] GET /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:40:30.107114 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-ed7997fd-2c48-461b-8911-1f334ba4a552 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:40:30.107589 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-ed7997fd-2c48-461b-8911-1f334ba4a552 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] [instance: 59ad64a5-af93-44ef-8031-fd2f2d18a901] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:40:30.114477 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-ed7997fd-2c48-461b-8911-1f334ba4a552 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:40:30.114927 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-ed7997fd-2c48-461b-8911-1f334ba4a552 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:40:30.115723 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-ed7997fd-2c48-461b-8911-1f334ba4a552 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:40:30.116167 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-ed7997fd-2c48-461b-8911-1f334ba4a552 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:40:30.145679 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-ed7997fd-2c48-461b-8911-1f334ba4a552 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] [instance: 59ad64a5-af93-44ef-8031-fd2f2d18a901] Going to try to terminate instance {{(pid=123387) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 21 09:40:30.404768 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-ed7997fd-2c48-461b-8911-1f334ba4a552 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "DELETE /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901" status: 204 len: 0 microversion: 2.20 time: 0.301035 Jan 21 09:40:30.405410 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 403/801] 10.222.0.45 () {60 vars in 1279 bytes} [Fri Jan 21 09:40:30 2022] DELETE /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jan 21 09:40:30.413809 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-96f0f2ca-86c5-47fd-85a9-443e34516b0c tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:40:30.414499 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-96f0f2ca-86c5-47fd-85a9-443e34516b0c tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] [instance: 59ad64a5-af93-44ef-8031-fd2f2d18a901] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:40:30.420361 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-96f0f2ca-86c5-47fd-85a9-443e34516b0c tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:40:30.420795 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-96f0f2ca-86c5-47fd-85a9-443e34516b0c tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:40:30.421601 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-96f0f2ca-86c5-47fd-85a9-443e34516b0c tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:40:30.422033 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-96f0f2ca-86c5-47fd-85a9-443e34516b0c tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:40:30.558993 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-96f0f2ca-86c5-47fd-85a9-443e34516b0c tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:40:30.567541 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-96f0f2ca-86c5-47fd-85a9-443e34516b0c tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:40:30.569052 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-96f0f2ca-86c5-47fd-85a9-443e34516b0c tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:40:30.570289 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-96f0f2ca-86c5-47fd-85a9-443e34516b0c tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "GET /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901" status: 200 len: 1723 microversion: 2.20 time: 0.160544 Jan 21 09:40:30.570857 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 404/802] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jan 21 09:40:30 2022] GET /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901 => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 21 09:40:31.589340 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-2266fd14-28fd-4001-84c5-32f634095bff tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:40:31.589940 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-2266fd14-28fd-4001-84c5-32f634095bff tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] [instance: 59ad64a5-af93-44ef-8031-fd2f2d18a901] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:40:31.596205 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-2266fd14-28fd-4001-84c5-32f634095bff tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:40:31.596666 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-2266fd14-28fd-4001-84c5-32f634095bff tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:40:31.597469 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-2266fd14-28fd-4001-84c5-32f634095bff tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:40:31.597908 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-2266fd14-28fd-4001-84c5-32f634095bff tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:40:31.727849 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-c3b8311f-309b-447a-86fe-bd14723eb361 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] 10.222.0.45 "POST /compute/v2.1/servers/9c18953a-7af3-4d71-97ad-05eda7e34a73/action" status: 200 len: 15025 microversion: 2.1 time: 2.445000 Jan 21 09:40:31.728636 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 399/803] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Jan 21 09:40:29 2022] POST /compute/v2.1/servers/9c18953a-7af3-4d71-97ad-05eda7e34a73/action => generated 15025 bytes in 2447 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 21 09:40:31.733527 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-2266fd14-28fd-4001-84c5-32f634095bff tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:40:31.742046 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-2266fd14-28fd-4001-84c5-32f634095bff tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:40:31.743765 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-2266fd14-28fd-4001-84c5-32f634095bff tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:40:31.744976 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-2266fd14-28fd-4001-84c5-32f634095bff tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "GET /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901" status: 200 len: 1723 microversion: 2.20 time: 0.159283 Jan 21 09:40:31.745519 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 405/804] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jan 21 09:40:31 2022] GET /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901 => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 21 09:40:32.740855 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-8c4f8c4d-f3ff-436f-bf28-36a4b3e0f31b tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:40:32.741891 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-8c4f8c4d-f3ff-436f-bf28-36a4b3e0f31b tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] [instance: 9c18953a-7af3-4d71-97ad-05eda7e34a73] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:40:32.748719 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-8c4f8c4d-f3ff-436f-bf28-36a4b3e0f31b tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:40:32.749181 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-8c4f8c4d-f3ff-436f-bf28-36a4b3e0f31b tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:40:32.749973 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-8c4f8c4d-f3ff-436f-bf28-36a4b3e0f31b tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:40:32.750425 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-8c4f8c4d-f3ff-436f-bf28-36a4b3e0f31b tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:40:32.764298 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-f189b73d-91c2-4d06-8754-1fec3b0c35ec tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:40:32.764863 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-f189b73d-91c2-4d06-8754-1fec3b0c35ec tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] [instance: 59ad64a5-af93-44ef-8031-fd2f2d18a901] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:40:32.773520 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-f189b73d-91c2-4d06-8754-1fec3b0c35ec tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:40:32.774002 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-f189b73d-91c2-4d06-8754-1fec3b0c35ec tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:40:32.774808 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-f189b73d-91c2-4d06-8754-1fec3b0c35ec tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:40:32.775250 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-f189b73d-91c2-4d06-8754-1fec3b0c35ec tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:40:32.831372 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-8c4f8c4d-f3ff-436f-bf28-36a4b3e0f31b tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] 10.222.0.45 "POST /compute/v2.1/servers/9c18953a-7af3-4d71-97ad-05eda7e34a73/action" status: 200 len: 18208 microversion: 2.1 time: 0.095173 Jan 21 09:40:32.833477 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 400/805] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Jan 21 09:40:32 2022] POST /compute/v2.1/servers/9c18953a-7af3-4d71-97ad-05eda7e34a73/action => generated 18208 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 21 09:40:32.934101 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-f189b73d-91c2-4d06-8754-1fec3b0c35ec tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:40:32.942597 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-f189b73d-91c2-4d06-8754-1fec3b0c35ec tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:40:32.944844 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-f189b73d-91c2-4d06-8754-1fec3b0c35ec tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:40:32.946069 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-f189b73d-91c2-4d06-8754-1fec3b0c35ec tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "GET /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901" status: 200 len: 1723 microversion: 2.20 time: 0.185591 Jan 21 09:40:32.946643 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 406/806] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jan 21 09:40:32 2022] GET /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901 => generated 1723 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 21 09:40:33.843607 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-7cbe93d5-314e-48be-9a19-89a9e682e4bf tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:40:33.844528 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-7cbe93d5-314e-48be-9a19-89a9e682e4bf tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] [instance: 9c18953a-7af3-4d71-97ad-05eda7e34a73] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:40:33.852389 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-7cbe93d5-314e-48be-9a19-89a9e682e4bf tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:40:33.852842 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-7cbe93d5-314e-48be-9a19-89a9e682e4bf tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:40:33.853722 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-7cbe93d5-314e-48be-9a19-89a9e682e4bf tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:40:33.854173 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-7cbe93d5-314e-48be-9a19-89a9e682e4bf tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:40:33.945131 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-7cbe93d5-314e-48be-9a19-89a9e682e4bf tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] 10.222.0.45 "POST /compute/v2.1/servers/9c18953a-7af3-4d71-97ad-05eda7e34a73/action" status: 200 len: 19342 microversion: 2.1 time: 0.105524 Jan 21 09:40:33.945901 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 401/807] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Jan 21 09:40:33 2022] POST /compute/v2.1/servers/9c18953a-7af3-4d71-97ad-05eda7e34a73/action => generated 19342 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 21 09:40:33.965026 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-6ac50843-98c7-4f75-a753-d140ad965a28 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:40:33.965671 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-6ac50843-98c7-4f75-a753-d140ad965a28 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] [instance: 59ad64a5-af93-44ef-8031-fd2f2d18a901] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:40:33.973678 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-6ac50843-98c7-4f75-a753-d140ad965a28 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:40:33.974126 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-6ac50843-98c7-4f75-a753-d140ad965a28 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:40:33.975108 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-6ac50843-98c7-4f75-a753-d140ad965a28 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:40:33.975509 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-6ac50843-98c7-4f75-a753-d140ad965a28 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:40:34.209008 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-6ac50843-98c7-4f75-a753-d140ad965a28 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:40:34.216637 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-6ac50843-98c7-4f75-a753-d140ad965a28 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:40:34.218365 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-6ac50843-98c7-4f75-a753-d140ad965a28 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:40:34.219661 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-6ac50843-98c7-4f75-a753-d140ad965a28 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "GET /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901" status: 200 len: 1723 microversion: 2.20 time: 0.258446 Jan 21 09:40:34.220347 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 407/808] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jan 21 09:40:33 2022] GET /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901 => generated 1723 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 21 09:40:34.957078 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-aa3cd95e-52f1-470e-ac51-7d3c010003e8 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:40:34.958632 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-aa3cd95e-52f1-470e-ac51-7d3c010003e8 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] [instance: 9c18953a-7af3-4d71-97ad-05eda7e34a73] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:40:34.965530 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-aa3cd95e-52f1-470e-ac51-7d3c010003e8 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:40:34.966208 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-aa3cd95e-52f1-470e-ac51-7d3c010003e8 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:40:34.967212 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-aa3cd95e-52f1-470e-ac51-7d3c010003e8 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:40:34.967820 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-aa3cd95e-52f1-470e-ac51-7d3c010003e8 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:40:35.054810 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [req-4baaebac-a6bf-46c4-ae13-63b3f530da6d req-2985bced-e9ad-4364-a2d7-101c7fe9fc56 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59ad64a5-af93-44ef-8031-fd2f2d18a901", "name": "network-vif-deleted", "tag": "63990fa3-fce3-4891-adb2-cd4ebc4c075a"}]} {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:40:35.054810 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 21 09:40:35.054810 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: warnings.warn(msg) Jan 21 09:40:35.054810 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [req-4baaebac-a6bf-46c4-ae13-63b3f530da6d req-2985bced-e9ad-4364-a2d7-101c7fe9fc56 service nova] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:40:35.054810 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [req-4baaebac-a6bf-46c4-ae13-63b3f530da6d req-2985bced-e9ad-4364-a2d7-101c7fe9fc56 service nova] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:40:35.064925 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-aa3cd95e-52f1-470e-ac51-7d3c010003e8 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] 10.222.0.45 "POST /compute/v2.1/servers/9c18953a-7af3-4d71-97ad-05eda7e34a73/action" status: 200 len: 21673 microversion: 2.1 time: 0.111339 Jan 21 09:40:35.066095 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 402/809] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Jan 21 09:40:34 2022] POST /compute/v2.1/servers/9c18953a-7af3-4d71-97ad-05eda7e34a73/action => generated 21673 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 21 09:40:35.066346 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.compute.server_external_events [req-4baaebac-a6bf-46c4-ae13-63b3f530da6d req-2985bced-e9ad-4364-a2d7-101c7fe9fc56 service nova] Creating event network-vif-deleted:63990fa3-fce3-4891-adb2-cd4ebc4c075a for instance 59ad64a5-af93-44ef-8031-fd2f2d18a901 on hv-cinder-80403 Jan 21 09:40:35.073463 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [req-4baaebac-a6bf-46c4-ae13-63b3f530da6d req-2985bced-e9ad-4364-a2d7-101c7fe9fc56 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036278 Jan 21 09:40:35.074160 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 408/810] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Jan 21 09:40:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 09:40:35.241600 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-3a704924-58c0-4d8f-b9bc-5986cf742554 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:40:35.242570 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-3a704924-58c0-4d8f-b9bc-5986cf742554 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] [instance: 59ad64a5-af93-44ef-8031-fd2f2d18a901] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:40:35.249616 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-3a704924-58c0-4d8f-b9bc-5986cf742554 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:40:35.250405 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-3a704924-58c0-4d8f-b9bc-5986cf742554 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:40:35.251475 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-3a704924-58c0-4d8f-b9bc-5986cf742554 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:40:35.251919 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-3a704924-58c0-4d8f-b9bc-5986cf742554 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:40:35.320699 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-3a704924-58c0-4d8f-b9bc-5986cf742554 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:40:35.330712 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-3a704924-58c0-4d8f-b9bc-5986cf742554 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:40:35.332916 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-3a704924-58c0-4d8f-b9bc-5986cf742554 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:40:35.334471 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-3a704924-58c0-4d8f-b9bc-5986cf742554 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "GET /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901" status: 200 len: 1366 microversion: 2.20 time: 0.099083 Jan 21 09:40:35.335682 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 403/811] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jan 21 09:40:35 2022] GET /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901 => generated 1366 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 21 09:40:36.080138 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-467b44c9-0b8a-42a5-b434-21a9ef7df8a9 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:40:36.081285 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-467b44c9-0b8a-42a5-b434-21a9ef7df8a9 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] [instance: 9c18953a-7af3-4d71-97ad-05eda7e34a73] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:40:36.088470 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-467b44c9-0b8a-42a5-b434-21a9ef7df8a9 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:40:36.089022 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-467b44c9-0b8a-42a5-b434-21a9ef7df8a9 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:40:36.089941 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-467b44c9-0b8a-42a5-b434-21a9ef7df8a9 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:40:36.090531 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-467b44c9-0b8a-42a5-b434-21a9ef7df8a9 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:40:36.352841 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-48c79cba-49c8-4c87-b947-c9cdb90e81b3 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:40:36.353462 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-48c79cba-49c8-4c87-b947-c9cdb90e81b3 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] [instance: 59ad64a5-af93-44ef-8031-fd2f2d18a901] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:40:36.360471 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-48c79cba-49c8-4c87-b947-c9cdb90e81b3 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:40:36.360927 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-48c79cba-49c8-4c87-b947-c9cdb90e81b3 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:40:36.361798 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-48c79cba-49c8-4c87-b947-c9cdb90e81b3 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:40:36.362246 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-48c79cba-49c8-4c87-b947-c9cdb90e81b3 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:40:36.396180 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-48c79cba-49c8-4c87-b947-c9cdb90e81b3 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:40:36.396180 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-48c79cba-49c8-4c87-b947-c9cdb90e81b3 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:40:36.396672 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.objects.instance [None req-48c79cba-49c8-4c87-b947-c9cdb90e81b3 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lazy-loading 'fault' on Instance uuid 59ad64a5-af93-44ef-8031-fd2f2d18a901 {{(pid=123386) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 21 09:40:36.436283 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-48c79cba-49c8-4c87-b947-c9cdb90e81b3 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:40:36.445325 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-48c79cba-49c8-4c87-b947-c9cdb90e81b3 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:40:36.446836 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-48c79cba-49c8-4c87-b947-c9cdb90e81b3 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:40:36.447991 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-48c79cba-49c8-4c87-b947-c9cdb90e81b3 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "GET /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901" status: 200 len: 1371 microversion: 2.20 time: 0.099938 Jan 21 09:40:36.448560 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 404/812] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jan 21 09:40:36 2022] GET /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901 => generated 1371 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 21 09:40:37.467018 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-b6574dd0-2836-49df-bf38-3667e5302c70 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:40:37.467639 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-b6574dd0-2836-49df-bf38-3667e5302c70 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] [instance: 59ad64a5-af93-44ef-8031-fd2f2d18a901] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:40:37.474612 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-b6574dd0-2836-49df-bf38-3667e5302c70 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:40:37.475056 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-b6574dd0-2836-49df-bf38-3667e5302c70 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:40:37.475841 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-b6574dd0-2836-49df-bf38-3667e5302c70 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:40:37.476273 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-b6574dd0-2836-49df-bf38-3667e5302c70 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:40:37.518459 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-b6574dd0-2836-49df-bf38-3667e5302c70 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:40:37.518911 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-b6574dd0-2836-49df-bf38-3667e5302c70 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:40:37.519503 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.objects.instance [None req-b6574dd0-2836-49df-bf38-3667e5302c70 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lazy-loading 'fault' on Instance uuid 59ad64a5-af93-44ef-8031-fd2f2d18a901 {{(pid=123386) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 21 09:40:37.561936 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-b6574dd0-2836-49df-bf38-3667e5302c70 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:40:37.571199 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-b6574dd0-2836-49df-bf38-3667e5302c70 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:40:37.572750 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-b6574dd0-2836-49df-bf38-3667e5302c70 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:40:37.574233 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-b6574dd0-2836-49df-bf38-3667e5302c70 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "GET /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901" status: 200 len: 1371 microversion: 2.20 time: 0.111258 Jan 21 09:40:37.574813 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 405/813] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jan 21 09:40:37 2022] GET /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901 => generated 1371 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 21 09:40:38.153720 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-467b44c9-0b8a-42a5-b434-21a9ef7df8a9 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] 10.222.0.45 "POST /compute/v2.1/servers/9c18953a-7af3-4d71-97ad-05eda7e34a73/action" status: 200 len: 24702 microversion: 2.1 time: 2.077984 Jan 21 09:40:38.154788 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 409/814] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Jan 21 09:40:36 2022] POST /compute/v2.1/servers/9c18953a-7af3-4d71-97ad-05eda7e34a73/action => generated 24702 bytes in 2080 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 21 09:40:38.602714 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-18cf21fb-dfee-4016-848e-9db0047a3d67 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:40:38.605901 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-18cf21fb-dfee-4016-848e-9db0047a3d67 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] [instance: 59ad64a5-af93-44ef-8031-fd2f2d18a901] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:40:38.617244 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-18cf21fb-dfee-4016-848e-9db0047a3d67 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:40:38.618243 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-18cf21fb-dfee-4016-848e-9db0047a3d67 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:40:38.619671 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-18cf21fb-dfee-4016-848e-9db0047a3d67 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:40:38.620449 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-18cf21fb-dfee-4016-848e-9db0047a3d67 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:40:38.657508 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-18cf21fb-dfee-4016-848e-9db0047a3d67 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:40:38.657994 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-18cf21fb-dfee-4016-848e-9db0047a3d67 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:40:38.658455 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.objects.instance [None req-18cf21fb-dfee-4016-848e-9db0047a3d67 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lazy-loading 'fault' on Instance uuid 59ad64a5-af93-44ef-8031-fd2f2d18a901 {{(pid=123386) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 21 09:40:38.702862 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-18cf21fb-dfee-4016-848e-9db0047a3d67 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:40:38.711878 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-18cf21fb-dfee-4016-848e-9db0047a3d67 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:40:38.716601 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-18cf21fb-dfee-4016-848e-9db0047a3d67 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:40:38.716601 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-18cf21fb-dfee-4016-848e-9db0047a3d67 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "GET /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901" status: 200 len: 1371 microversion: 2.20 time: 0.121149 Jan 21 09:40:38.716601 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 406/815] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jan 21 09:40:38 2022] GET /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901 => generated 1371 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 21 09:40:39.168841 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-20586bba-f1fa-4d3d-ae42-8be9f4aae635 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:40:39.169902 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-20586bba-f1fa-4d3d-ae42-8be9f4aae635 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] [instance: 9c18953a-7af3-4d71-97ad-05eda7e34a73] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:40:39.178409 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-20586bba-f1fa-4d3d-ae42-8be9f4aae635 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:40:39.178867 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-20586bba-f1fa-4d3d-ae42-8be9f4aae635 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:40:39.179674 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-20586bba-f1fa-4d3d-ae42-8be9f4aae635 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:40:39.180116 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-20586bba-f1fa-4d3d-ae42-8be9f4aae635 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:40:39.265975 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-20586bba-f1fa-4d3d-ae42-8be9f4aae635 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] 10.222.0.45 "POST /compute/v2.1/servers/9c18953a-7af3-4d71-97ad-05eda7e34a73/action" status: 200 len: 25854 microversion: 2.1 time: 0.101265 Jan 21 09:40:39.266634 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 410/816] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Jan 21 09:40:39 2022] POST /compute/v2.1/servers/9c18953a-7af3-4d71-97ad-05eda7e34a73/action => generated 25854 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 21 09:40:39.733075 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-8840f307-9427-48f9-8147-d9fef4f1f98e tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:40:39.734178 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-8840f307-9427-48f9-8147-d9fef4f1f98e tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] [instance: 59ad64a5-af93-44ef-8031-fd2f2d18a901] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:40:39.742461 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-8840f307-9427-48f9-8147-d9fef4f1f98e tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:40:39.805088 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-8840f307-9427-48f9-8147-d9fef4f1f98e tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:40:39.805088 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-8840f307-9427-48f9-8147-d9fef4f1f98e tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:40:39.805088 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-8840f307-9427-48f9-8147-d9fef4f1f98e tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:40:39.805088 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.wsgi [None req-8840f307-9427-48f9-8147-d9fef4f1f98e tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] HTTP exception thrown: Instance 59ad64a5-af93-44ef-8031-fd2f2d18a901 could not be found. Jan 21 09:40:39.805877 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-8840f307-9427-48f9-8147-d9fef4f1f98e tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Returning 404 to user: Instance 59ad64a5-af93-44ef-8031-fd2f2d18a901 could not be found. {{(pid=123386) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 21 09:40:39.805877 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-8840f307-9427-48f9-8147-d9fef4f1f98e tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "GET /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901" status: 404 len: 111 microversion: 2.20 time: 0.035539 Jan 21 09:40:39.805877 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 407/817] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jan 21 09:40:39 2022] GET /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jan 21 09:40:39.806378 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-c16d7e8f-8a83-4d5d-9c18-599542f8cd54 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Calling method '.version_select at 0x7fb6c2af2dc0>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:40:40.038694 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-c16d7e8f-8a83-4d5d-9c18-599542f8cd54 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-367654863" status: 204 len: 0 microversion: 2.20 time: 0.267282 Jan 21 09:40:40.039319 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 411/818] 10.222.0.45 () {60 vars in 1258 bytes} [Fri Jan 21 09:40:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-367654863 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jan 21 09:40:40.278611 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-31d942f2-216b-4b41-aedc-918a5f5f5c56 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:40:40.279587 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-31d942f2-216b-4b41-aedc-918a5f5f5c56 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] [instance: 9c18953a-7af3-4d71-97ad-05eda7e34a73] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:40:40.288036 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-31d942f2-216b-4b41-aedc-918a5f5f5c56 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:40:40.288756 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-31d942f2-216b-4b41-aedc-918a5f5f5c56 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:40:40.289802 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-31d942f2-216b-4b41-aedc-918a5f5f5c56 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:40:40.290252 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-31d942f2-216b-4b41-aedc-918a5f5f5c56 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:40:40.378883 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-31d942f2-216b-4b41-aedc-918a5f5f5c56 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] 10.222.0.45 "POST /compute/v2.1/servers/9c18953a-7af3-4d71-97ad-05eda7e34a73/action" status: 200 len: 26915 microversion: 2.1 time: 0.097768 Jan 21 09:40:40.378883 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 408/819] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Jan 21 09:40:40 2022] POST /compute/v2.1/servers/9c18953a-7af3-4d71-97ad-05eda7e34a73/action => generated 26915 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 21 09:40:40.947086 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-939829ec-3d4a-4d67-96da-105069d73fec tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Action: 'create', calling method: .version_select at 0x7fb6c2aefa60>, body: {"keypair": {"name": "tempest-keypair-1032408331"}} {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:40:40.961771 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.quota [None req-939829ec-3d4a-4d67-96da-105069d73fec tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Getting quotas for project 93281ac9cb504124a055279296f2262f. Resources: {'key_pairs'} {{(pid=123387) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 21 09:40:40.965637 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.quota [None req-939829ec-3d4a-4d67-96da-105069d73fec tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Getting quotas for user c190858354e14533a06a1fac88f2cfd3 and project 93281ac9cb504124a055279296f2262f. Resources: {'key_pairs'} {{(pid=123387) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 21 09:40:41.387414 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-d4c9f238-768f-4acd-aab4-3d58b8f8522b tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:40:41.388397 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-d4c9f238-768f-4acd-aab4-3d58b8f8522b tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] [instance: 9c18953a-7af3-4d71-97ad-05eda7e34a73] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:40:41.396358 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-d4c9f238-768f-4acd-aab4-3d58b8f8522b tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:40:41.396814 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-d4c9f238-768f-4acd-aab4-3d58b8f8522b tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:40:41.397687 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-d4c9f238-768f-4acd-aab4-3d58b8f8522b tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:40:41.398129 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-d4c9f238-768f-4acd-aab4-3d58b8f8522b tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:40:41.417414 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.quota [None req-939829ec-3d4a-4d67-96da-105069d73fec tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Getting quotas for project 93281ac9cb504124a055279296f2262f. Resources: {'key_pairs'} {{(pid=123387) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 21 09:40:41.421741 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.quota [None req-939829ec-3d4a-4d67-96da-105069d73fec tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Getting quotas for user c190858354e14533a06a1fac88f2cfd3 and project 93281ac9cb504124a055279296f2262f. Resources: {'key_pairs'} {{(pid=123387) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 21 09:40:41.437698 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-939829ec-3d4a-4d67-96da-105069d73fec tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 201 len: 2316 microversion: 2.20 time: 0.497063 Jan 21 09:40:41.439242 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 412/820] 10.222.0.45 () {62 vars in 1198 bytes} [Fri Jan 21 09:40:40 2022] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 499 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Jan 21 09:40:41.489682 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-d4c9f238-768f-4acd-aab4-3d58b8f8522b tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] 10.222.0.45 "POST /compute/v2.1/servers/9c18953a-7af3-4d71-97ad-05eda7e34a73/action" status: 200 len: 27584 microversion: 2.1 time: 0.106041 Jan 21 09:40:41.490640 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 409/821] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Jan 21 09:40:41 2022] POST /compute/v2.1/servers/9c18953a-7af3-4d71-97ad-05eda7e34a73/action => generated 27584 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 21 09:40:42.504813 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-45af4b84-48cd-4b74-b1f7-52d6d4f6ed29 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:40:42.506731 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-45af4b84-48cd-4b74-b1f7-52d6d4f6ed29 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] [instance: 9c18953a-7af3-4d71-97ad-05eda7e34a73] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:40:42.512985 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-45af4b84-48cd-4b74-b1f7-52d6d4f6ed29 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:40:42.514380 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-45af4b84-48cd-4b74-b1f7-52d6d4f6ed29 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:40:42.514380 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-45af4b84-48cd-4b74-b1f7-52d6d4f6ed29 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:40:42.514926 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-45af4b84-48cd-4b74-b1f7-52d6d4f6ed29 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:40:42.601255 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-45af4b84-48cd-4b74-b1f7-52d6d4f6ed29 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] 10.222.0.45 "POST /compute/v2.1/servers/9c18953a-7af3-4d71-97ad-05eda7e34a73/action" status: 200 len: 27942 microversion: 2.1 time: 0.100695 Jan 21 09:40:42.606903 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 413/822] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Jan 21 09:40:42 2022] POST /compute/v2.1/servers/9c18953a-7af3-4d71-97ad-05eda7e34a73/action => generated 27942 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 21 09:40:43.620795 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-b985bccc-bfa0-404e-9360-7a7dfad7966f tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:40:43.623280 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-b985bccc-bfa0-404e-9360-7a7dfad7966f tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] [instance: 9c18953a-7af3-4d71-97ad-05eda7e34a73] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:40:43.630584 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-b985bccc-bfa0-404e-9360-7a7dfad7966f tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:40:43.631028 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-b985bccc-bfa0-404e-9360-7a7dfad7966f tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:40:43.631885 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-b985bccc-bfa0-404e-9360-7a7dfad7966f tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:40:43.632336 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-b985bccc-bfa0-404e-9360-7a7dfad7966f tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:40:43.726414 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-b985bccc-bfa0-404e-9360-7a7dfad7966f tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] 10.222.0.45 "POST /compute/v2.1/servers/9c18953a-7af3-4d71-97ad-05eda7e34a73/action" status: 200 len: 28180 microversion: 2.1 time: 0.109161 Jan 21 09:40:43.728419 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 410/823] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Jan 21 09:40:43 2022] POST /compute/v2.1/servers/9c18953a-7af3-4d71-97ad-05eda7e34a73/action => generated 28180 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 21 09:40:43.932363 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-63c7d070-dd8c-49e0-94a7-b438bc8acacc tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-719014147", "imageRef": "813e53ee-82e7-4a13-9f63-a8be7b1089f1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "647e31d1-4208-41da-8947-db9d9292bd9e"}], "security_groups": [{"name": "tempest-securitygroup--973377228"}], "key_name": "tempest-keypair-1032408331", "user_data": "}} {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:40:44.055588 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.network.neutron [None req-63c7d070-dd8c-49e0-94a7-b438bc8acacc tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] validate_networks() for [('647e31d1-4208-41da-8947-db9d9292bd9e', None, None, None, None, None)] {{(pid=123387) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 21 09:40:44.492012 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.virt.hardware [None req-63c7d070-dd8c-49e0-94a7-b438bc8acacc tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Flavor limits 0:0:0 {{(pid=123387) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 21 09:40:44.492438 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.virt.hardware [None req-63c7d070-dd8c-49e0-94a7-b438bc8acacc tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Image limits 0:0:0 {{(pid=123387) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 21 09:40:44.492919 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.virt.hardware [None req-63c7d070-dd8c-49e0-94a7-b438bc8acacc tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Flavor pref 0:0:0 {{(pid=123387) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 21 09:40:44.493374 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.virt.hardware [None req-63c7d070-dd8c-49e0-94a7-b438bc8acacc tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Image pref 0:0:0 {{(pid=123387) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 21 09:40:44.493837 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.virt.hardware [None req-63c7d070-dd8c-49e0-94a7-b438bc8acacc tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123387) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 21 09:40:44.503438 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-63c7d070-dd8c-49e0-94a7-b438bc8acacc tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:40:44.503943 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-63c7d070-dd8c-49e0-94a7-b438bc8acacc tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:40:44.506101 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-63c7d070-dd8c-49e0-94a7-b438bc8acacc tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:40:44.506543 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-63c7d070-dd8c-49e0-94a7-b438bc8acacc tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:40:44.525391 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.quota [None req-63c7d070-dd8c-49e0-94a7-b438bc8acacc tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Getting quotas for project 93281ac9cb504124a055279296f2262f. Resources: {'cores', 'instances', 'ram'} {{(pid=123387) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 21 09:40:44.529577 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.quota [None req-63c7d070-dd8c-49e0-94a7-b438bc8acacc tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Getting quotas for user c190858354e14533a06a1fac88f2cfd3 and project 93281ac9cb504124a055279296f2262f. Resources: {'cores', 'instances', 'ram'} {{(pid=123387) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 21 09:40:44.541955 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-63c7d070-dd8c-49e0-94a7-b438bc8acacc tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Going to run 1 instances... {{(pid=123387) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 21 09:40:44.544393 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-63c7d070-dd8c-49e0-94a7-b438bc8acacc tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] [instance: e3dd8a17-5a2f-4f39-a110-208165e07110] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='813e53ee-82e7-4a13-9f63-a8be7b1089f1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123387) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 21 09:40:44.675334 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-63c7d070-dd8c-49e0-94a7-b438bc8acacc tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.747363 Jan 21 09:40:44.676169 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 414/824] 10.222.0.45 () {62 vars in 1187 bytes} [Fri Jan 21 09:40:43 2022] POST /compute/v2.1/servers => generated 401 bytes in 749 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jan 21 09:40:44.690798 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-2aaf8882-c201-4e46-8199-5b460f69b891 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:40:44.692448 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-2aaf8882-c201-4e46-8199-5b460f69b891 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] [instance: e3dd8a17-5a2f-4f39-a110-208165e07110] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:40:44.745668 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-538a097d-cdb3-4f9f-9d9a-6920cd841e3e tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:40:44.746942 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-538a097d-cdb3-4f9f-9d9a-6920cd841e3e tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] [instance: 9c18953a-7af3-4d71-97ad-05eda7e34a73] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:40:44.757372 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-538a097d-cdb3-4f9f-9d9a-6920cd841e3e tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:40:44.757991 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-538a097d-cdb3-4f9f-9d9a-6920cd841e3e tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:40:44.759030 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-538a097d-cdb3-4f9f-9d9a-6920cd841e3e tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:40:44.760225 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-538a097d-cdb3-4f9f-9d9a-6920cd841e3e tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:40:44.771251 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-2aaf8882-c201-4e46-8199-5b460f69b891 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:40:44.792080 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-2aaf8882-c201-4e46-8199-5b460f69b891 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:40:44.794919 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-2aaf8882-c201-4e46-8199-5b460f69b891 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:40:44.796666 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-2aaf8882-c201-4e46-8199-5b460f69b891 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "GET /compute/v2.1/servers/e3dd8a17-5a2f-4f39-a110-208165e07110" status: 200 len: 1281 microversion: 2.20 time: 0.112052 Jan 21 09:40:44.797907 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 411/825] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jan 21 09:40:44 2022] GET /compute/v2.1/servers/e3dd8a17-5a2f-4f39-a110-208165e07110 => generated 1281 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 21 09:40:44.844365 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-538a097d-cdb3-4f9f-9d9a-6920cd841e3e tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] 10.222.0.45 "POST /compute/v2.1/servers/9c18953a-7af3-4d71-97ad-05eda7e34a73/action" status: 200 len: 28180 microversion: 2.1 time: 0.104972 Jan 21 09:40:44.844365 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 415/826] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Jan 21 09:40:44 2022] POST /compute/v2.1/servers/9c18953a-7af3-4d71-97ad-05eda7e34a73/action => generated 28180 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 21 09:40:45.824996 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-be2d4bf8-3770-459b-aa9e-52b1b9df7ce4 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:40:45.832720 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-be2d4bf8-3770-459b-aa9e-52b1b9df7ce4 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] [instance: e3dd8a17-5a2f-4f39-a110-208165e07110] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:40:45.842272 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-be2d4bf8-3770-459b-aa9e-52b1b9df7ce4 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:40:45.842721 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-be2d4bf8-3770-459b-aa9e-52b1b9df7ce4 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:40:45.843515 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-be2d4bf8-3770-459b-aa9e-52b1b9df7ce4 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:40:45.843946 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-be2d4bf8-3770-459b-aa9e-52b1b9df7ce4 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:40:45.857251 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-536392ca-8cce-46e5-bd4d-1c6d6edcaafc tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:40:45.858403 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-536392ca-8cce-46e5-bd4d-1c6d6edcaafc tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] [instance: 9c18953a-7af3-4d71-97ad-05eda7e34a73] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:40:45.873232 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-536392ca-8cce-46e5-bd4d-1c6d6edcaafc tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:40:45.873772 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-536392ca-8cce-46e5-bd4d-1c6d6edcaafc tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:40:45.874634 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-536392ca-8cce-46e5-bd4d-1c6d6edcaafc tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:40:45.875070 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-536392ca-8cce-46e5-bd4d-1c6d6edcaafc tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:40:45.922318 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-be2d4bf8-3770-459b-aa9e-52b1b9df7ce4 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:40:45.932602 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-be2d4bf8-3770-459b-aa9e-52b1b9df7ce4 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:40:45.935126 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-be2d4bf8-3770-459b-aa9e-52b1b9df7ce4 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:40:45.936324 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-be2d4bf8-3770-459b-aa9e-52b1b9df7ce4 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "GET /compute/v2.1/servers/e3dd8a17-5a2f-4f39-a110-208165e07110" status: 200 len: 1285 microversion: 2.20 time: 0.121837 Jan 21 09:40:45.937419 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 412/827] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jan 21 09:40:45 2022] GET /compute/v2.1/servers/e3dd8a17-5a2f-4f39-a110-208165e07110 => generated 1285 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 21 09:40:45.962795 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-536392ca-8cce-46e5-bd4d-1c6d6edcaafc tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] 10.222.0.45 "POST /compute/v2.1/servers/9c18953a-7af3-4d71-97ad-05eda7e34a73/action" status: 200 len: 28471 microversion: 2.1 time: 0.109771 Jan 21 09:40:45.963582 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 416/828] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Jan 21 09:40:45 2022] POST /compute/v2.1/servers/9c18953a-7af3-4d71-97ad-05eda7e34a73/action => generated 28471 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 21 09:40:46.956836 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-8e8f250c-c51f-4fe7-a12c-b6e17d0d2605 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:40:46.957668 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-8e8f250c-c51f-4fe7-a12c-b6e17d0d2605 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] [instance: e3dd8a17-5a2f-4f39-a110-208165e07110] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:40:46.966642 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-8e8f250c-c51f-4fe7-a12c-b6e17d0d2605 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:40:46.967092 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-8e8f250c-c51f-4fe7-a12c-b6e17d0d2605 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:40:46.968020 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-8e8f250c-c51f-4fe7-a12c-b6e17d0d2605 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:40:46.968506 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-8e8f250c-c51f-4fe7-a12c-b6e17d0d2605 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:40:46.978396 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-0ad0f738-33f6-4460-a34f-b0dd01f9060c tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:40:46.979986 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-0ad0f738-33f6-4460-a34f-b0dd01f9060c tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] [instance: 9c18953a-7af3-4d71-97ad-05eda7e34a73] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:40:46.989396 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-0ad0f738-33f6-4460-a34f-b0dd01f9060c tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:40:46.989396 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-0ad0f738-33f6-4460-a34f-b0dd01f9060c tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:40:46.990751 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-0ad0f738-33f6-4460-a34f-b0dd01f9060c tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:40:46.991266 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-0ad0f738-33f6-4460-a34f-b0dd01f9060c tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:40:47.093549 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-0ad0f738-33f6-4460-a34f-b0dd01f9060c tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] 10.222.0.45 "POST /compute/v2.1/servers/9c18953a-7af3-4d71-97ad-05eda7e34a73/action" status: 200 len: 28594 microversion: 2.1 time: 0.120841 Jan 21 09:40:47.094249 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 417/829] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Jan 21 09:40:46 2022] POST /compute/v2.1/servers/9c18953a-7af3-4d71-97ad-05eda7e34a73/action => generated 28594 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 21 09:40:47.287808 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-8e8f250c-c51f-4fe7-a12c-b6e17d0d2605 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:40:47.296950 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-8e8f250c-c51f-4fe7-a12c-b6e17d0d2605 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:40:47.299023 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-8e8f250c-c51f-4fe7-a12c-b6e17d0d2605 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:40:47.300270 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-8e8f250c-c51f-4fe7-a12c-b6e17d0d2605 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "GET /compute/v2.1/servers/e3dd8a17-5a2f-4f39-a110-208165e07110" status: 200 len: 1341 microversion: 2.20 time: 0.347483 Jan 21 09:40:47.302167 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 413/830] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jan 21 09:40:46 2022] GET /compute/v2.1/servers/e3dd8a17-5a2f-4f39-a110-208165e07110 => generated 1341 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 21 09:40:48.119014 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-6fdb6398-2626-4785-ac1e-0cd85c8e9d73 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:40:48.125885 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-6fdb6398-2626-4785-ac1e-0cd85c8e9d73 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] [instance: 9c18953a-7af3-4d71-97ad-05eda7e34a73] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:40:48.135420 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-6fdb6398-2626-4785-ac1e-0cd85c8e9d73 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:40:48.135862 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-6fdb6398-2626-4785-ac1e-0cd85c8e9d73 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:40:48.136670 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-6fdb6398-2626-4785-ac1e-0cd85c8e9d73 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:40:48.137104 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-6fdb6398-2626-4785-ac1e-0cd85c8e9d73 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:40:48.225525 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-6fdb6398-2626-4785-ac1e-0cd85c8e9d73 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] 10.222.0.45 "POST /compute/v2.1/servers/9c18953a-7af3-4d71-97ad-05eda7e34a73/action" status: 200 len: 28639 microversion: 2.1 time: 0.120645 Jan 21 09:40:48.230133 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 418/831] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Jan 21 09:40:48 2022] POST /compute/v2.1/servers/9c18953a-7af3-4d71-97ad-05eda7e34a73/action => generated 28639 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 21 09:40:48.320591 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-0f50fb72-1fa6-40b8-9101-97982230cb7d tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:40:48.321233 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-0f50fb72-1fa6-40b8-9101-97982230cb7d tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] [instance: e3dd8a17-5a2f-4f39-a110-208165e07110] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:40:48.330384 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-0f50fb72-1fa6-40b8-9101-97982230cb7d tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:40:48.330384 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-0f50fb72-1fa6-40b8-9101-97982230cb7d tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:40:48.330384 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-0f50fb72-1fa6-40b8-9101-97982230cb7d tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:40:48.330384 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-0f50fb72-1fa6-40b8-9101-97982230cb7d tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:40:48.534584 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-0f50fb72-1fa6-40b8-9101-97982230cb7d tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:40:48.544057 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-0f50fb72-1fa6-40b8-9101-97982230cb7d tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:40:48.545654 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-0f50fb72-1fa6-40b8-9101-97982230cb7d tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:40:48.546760 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-0f50fb72-1fa6-40b8-9101-97982230cb7d tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "GET /compute/v2.1/servers/e3dd8a17-5a2f-4f39-a110-208165e07110" status: 200 len: 1406 microversion: 2.20 time: 0.230887 Jan 21 09:40:48.547320 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 414/832] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jan 21 09:40:48 2022] GET /compute/v2.1/servers/e3dd8a17-5a2f-4f39-a110-208165e07110 => generated 1406 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 21 09:40:48.939861 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [req-cc36e144-faaf-48a0-becc-ab98784ad616 req-b3af0527-0ec6-4028-9949-3c5d3a84bd94 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e3dd8a17-5a2f-4f39-a110-208165e07110", "tag": "248e29e3-d311-4074-bc03-c8c881428352"}]} {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:40:48.943235 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 21 09:40:48.943235 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: warnings.warn(msg) Jan 21 09:40:48.951342 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [req-cc36e144-faaf-48a0-becc-ab98784ad616 req-b3af0527-0ec6-4028-9949-3c5d3a84bd94 service nova] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:40:48.951787 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [req-cc36e144-faaf-48a0-becc-ab98784ad616 req-b3af0527-0ec6-4028-9949-3c5d3a84bd94 service nova] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:40:48.971908 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.compute.server_external_events [req-cc36e144-faaf-48a0-becc-ab98784ad616 req-b3af0527-0ec6-4028-9949-3c5d3a84bd94 service nova] Creating event network-changed:248e29e3-d311-4074-bc03-c8c881428352 for instance e3dd8a17-5a2f-4f39-a110-208165e07110 on hv-cinder-80403 Jan 21 09:40:48.978694 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [req-cc36e144-faaf-48a0-becc-ab98784ad616 req-b3af0527-0ec6-4028-9949-3c5d3a84bd94 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049496 Jan 21 09:40:48.980047 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 419/833] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Jan 21 09:40:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 09:40:49.238990 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-d01a1ec0-2637-42f6-8dd4-dd3e68836dcf tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:40:49.240565 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-d01a1ec0-2637-42f6-8dd4-dd3e68836dcf tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] [instance: 9c18953a-7af3-4d71-97ad-05eda7e34a73] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:40:49.247037 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-d01a1ec0-2637-42f6-8dd4-dd3e68836dcf tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:40:49.247590 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-d01a1ec0-2637-42f6-8dd4-dd3e68836dcf tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:40:49.248383 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-d01a1ec0-2637-42f6-8dd4-dd3e68836dcf tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:40:49.249120 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-d01a1ec0-2637-42f6-8dd4-dd3e68836dcf tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:40:49.327025 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-d01a1ec0-2637-42f6-8dd4-dd3e68836dcf tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] 10.222.0.45 "POST /compute/v2.1/servers/9c18953a-7af3-4d71-97ad-05eda7e34a73/action" status: 200 len: 28639 microversion: 2.1 time: 0.092557 Jan 21 09:40:49.327706 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 415/834] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Jan 21 09:40:49 2022] POST /compute/v2.1/servers/9c18953a-7af3-4d71-97ad-05eda7e34a73/action => generated 28639 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 21 09:40:49.566043 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-fbec9338-a150-47e9-a80b-0acf93af10db tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:40:49.566868 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-fbec9338-a150-47e9-a80b-0acf93af10db tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] [instance: e3dd8a17-5a2f-4f39-a110-208165e07110] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:40:49.572957 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-fbec9338-a150-47e9-a80b-0acf93af10db tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:40:49.573416 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-fbec9338-a150-47e9-a80b-0acf93af10db tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:40:49.574219 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-fbec9338-a150-47e9-a80b-0acf93af10db tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:40:49.574648 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-fbec9338-a150-47e9-a80b-0acf93af10db tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:40:49.856466 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-fbec9338-a150-47e9-a80b-0acf93af10db tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:40:49.864951 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-fbec9338-a150-47e9-a80b-0acf93af10db tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:40:49.866511 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-fbec9338-a150-47e9-a80b-0acf93af10db tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:40:49.867615 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-fbec9338-a150-47e9-a80b-0acf93af10db tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "GET /compute/v2.1/servers/e3dd8a17-5a2f-4f39-a110-208165e07110" status: 200 len: 1406 microversion: 2.20 time: 0.306195 Jan 21 09:40:49.868182 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 420/835] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jan 21 09:40:49 2022] GET /compute/v2.1/servers/e3dd8a17-5a2f-4f39-a110-208165e07110 => generated 1406 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 21 09:40:50.339530 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-a7a6a8d4-bf2e-4624-8721-ca7e55c5e55b tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:40:50.340461 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-a7a6a8d4-bf2e-4624-8721-ca7e55c5e55b tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] [instance: 9c18953a-7af3-4d71-97ad-05eda7e34a73] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:40:50.347261 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-a7a6a8d4-bf2e-4624-8721-ca7e55c5e55b tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:40:50.347907 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-a7a6a8d4-bf2e-4624-8721-ca7e55c5e55b tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:40:50.348918 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-a7a6a8d4-bf2e-4624-8721-ca7e55c5e55b tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:40:50.349386 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-a7a6a8d4-bf2e-4624-8721-ca7e55c5e55b tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:40:50.421688 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-a7a6a8d4-bf2e-4624-8721-ca7e55c5e55b tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] 10.222.0.45 "POST /compute/v2.1/servers/9c18953a-7af3-4d71-97ad-05eda7e34a73/action" status: 200 len: 28639 microversion: 2.1 time: 0.086150 Jan 21 09:40:50.422362 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 416/836] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Jan 21 09:40:50 2022] POST /compute/v2.1/servers/9c18953a-7af3-4d71-97ad-05eda7e34a73/action => generated 28639 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 21 09:40:50.885789 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-edbf6bbb-bce4-4518-afd4-5aa6947e41c5 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:40:50.886436 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-edbf6bbb-bce4-4518-afd4-5aa6947e41c5 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] [instance: e3dd8a17-5a2f-4f39-a110-208165e07110] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:40:50.893175 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-edbf6bbb-bce4-4518-afd4-5aa6947e41c5 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:40:50.893595 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-edbf6bbb-bce4-4518-afd4-5aa6947e41c5 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:40:50.894390 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-edbf6bbb-bce4-4518-afd4-5aa6947e41c5 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:40:50.895729 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-edbf6bbb-bce4-4518-afd4-5aa6947e41c5 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:40:51.032348 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-edbf6bbb-bce4-4518-afd4-5aa6947e41c5 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:40:51.042276 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-edbf6bbb-bce4-4518-afd4-5aa6947e41c5 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:40:51.043768 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-edbf6bbb-bce4-4518-afd4-5aa6947e41c5 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:40:51.044867 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-edbf6bbb-bce4-4518-afd4-5aa6947e41c5 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "GET /compute/v2.1/servers/e3dd8a17-5a2f-4f39-a110-208165e07110" status: 200 len: 1406 microversion: 2.20 time: 0.162832 Jan 21 09:40:51.045468 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 421/837] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jan 21 09:40:50 2022] GET /compute/v2.1/servers/e3dd8a17-5a2f-4f39-a110-208165e07110 => generated 1406 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 21 09:40:51.436169 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-efc12795-e8d7-40b2-bbca-34e1d4c8845c tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:40:51.436169 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-efc12795-e8d7-40b2-bbca-34e1d4c8845c tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] [instance: 9c18953a-7af3-4d71-97ad-05eda7e34a73] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:40:51.443982 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-efc12795-e8d7-40b2-bbca-34e1d4c8845c tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:40:51.444434 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-efc12795-e8d7-40b2-bbca-34e1d4c8845c tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:40:51.445279 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-efc12795-e8d7-40b2-bbca-34e1d4c8845c tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:40:51.445721 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-efc12795-e8d7-40b2-bbca-34e1d4c8845c tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:40:51.515255 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-efc12795-e8d7-40b2-bbca-34e1d4c8845c tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] 10.222.0.45 "POST /compute/v2.1/servers/9c18953a-7af3-4d71-97ad-05eda7e34a73/action" status: 200 len: 28639 microversion: 2.1 time: 0.084919 Jan 21 09:40:51.515909 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 417/838] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Jan 21 09:40:51 2022] POST /compute/v2.1/servers/9c18953a-7af3-4d71-97ad-05eda7e34a73/action => generated 28639 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 21 09:40:52.064998 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-e1c5b604-2e53-4960-9647-e4b8464b410c tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:40:52.065849 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-e1c5b604-2e53-4960-9647-e4b8464b410c tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] [instance: e3dd8a17-5a2f-4f39-a110-208165e07110] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:40:52.073071 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-e1c5b604-2e53-4960-9647-e4b8464b410c tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:40:52.073492 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-e1c5b604-2e53-4960-9647-e4b8464b410c tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:40:52.074325 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-e1c5b604-2e53-4960-9647-e4b8464b410c tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:40:52.074771 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-e1c5b604-2e53-4960-9647-e4b8464b410c tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:40:52.226519 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-e1c5b604-2e53-4960-9647-e4b8464b410c tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:40:52.235284 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-e1c5b604-2e53-4960-9647-e4b8464b410c tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:40:52.236790 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-e1c5b604-2e53-4960-9647-e4b8464b410c tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:40:52.237937 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-e1c5b604-2e53-4960-9647-e4b8464b410c tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "GET /compute/v2.1/servers/e3dd8a17-5a2f-4f39-a110-208165e07110" status: 200 len: 1406 microversion: 2.20 time: 0.176664 Jan 21 09:40:52.239337 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 422/839] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jan 21 09:40:52 2022] GET /compute/v2.1/servers/e3dd8a17-5a2f-4f39-a110-208165e07110 => generated 1406 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 21 09:40:52.527431 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-6c353d76-b04d-4e91-ba6f-dac1008d99f7 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:40:52.528437 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-6c353d76-b04d-4e91-ba6f-dac1008d99f7 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] [instance: 9c18953a-7af3-4d71-97ad-05eda7e34a73] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:40:52.535613 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-6c353d76-b04d-4e91-ba6f-dac1008d99f7 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:40:52.536096 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-6c353d76-b04d-4e91-ba6f-dac1008d99f7 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:40:52.536941 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-6c353d76-b04d-4e91-ba6f-dac1008d99f7 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:40:52.537408 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-6c353d76-b04d-4e91-ba6f-dac1008d99f7 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:40:52.627925 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-6c353d76-b04d-4e91-ba6f-dac1008d99f7 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] 10.222.0.45 "POST /compute/v2.1/servers/9c18953a-7af3-4d71-97ad-05eda7e34a73/action" status: 200 len: 29575 microversion: 2.1 time: 0.104221 Jan 21 09:40:52.628494 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 418/840] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Jan 21 09:40:52 2022] POST /compute/v2.1/servers/9c18953a-7af3-4d71-97ad-05eda7e34a73/action => generated 29575 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 21 09:40:53.257123 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-6ce2e48a-7c0e-4546-957a-c020f92b740a tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:40:53.257742 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-6ce2e48a-7c0e-4546-957a-c020f92b740a tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] [instance: e3dd8a17-5a2f-4f39-a110-208165e07110] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:40:53.264713 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-6ce2e48a-7c0e-4546-957a-c020f92b740a tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:40:53.265166 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-6ce2e48a-7c0e-4546-957a-c020f92b740a tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:40:53.265980 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-6ce2e48a-7c0e-4546-957a-c020f92b740a tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:40:53.266503 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-6ce2e48a-7c0e-4546-957a-c020f92b740a tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:40:53.458122 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-6ce2e48a-7c0e-4546-957a-c020f92b740a tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:40:53.467929 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-6ce2e48a-7c0e-4546-957a-c020f92b740a tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:40:53.469799 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-6ce2e48a-7c0e-4546-957a-c020f92b740a tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:40:53.470914 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-6ce2e48a-7c0e-4546-957a-c020f92b740a tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "GET /compute/v2.1/servers/e3dd8a17-5a2f-4f39-a110-208165e07110" status: 200 len: 1406 microversion: 2.20 time: 0.218528 Jan 21 09:40:53.471701 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 423/841] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jan 21 09:40:53 2022] GET /compute/v2.1/servers/e3dd8a17-5a2f-4f39-a110-208165e07110 => generated 1406 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 21 09:40:53.568139 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [req-c09463cf-c638-4741-aa95-42da10be3ead req-9d024fc9-d252-4944-bbce-3a5eef074f14 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3dd8a17-5a2f-4f39-a110-208165e07110", "name": "network-vif-plugged", "status": "completed", "tag": "248e29e3-d311-4074-bc03-c8c881428352"}]} {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:40:53.569855 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 21 09:40:53.569855 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: warnings.warn(msg) Jan 21 09:40:53.578402 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [req-c09463cf-c638-4741-aa95-42da10be3ead req-9d024fc9-d252-4944-bbce-3a5eef074f14 service nova] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:40:53.578849 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [req-c09463cf-c638-4741-aa95-42da10be3ead req-9d024fc9-d252-4944-bbce-3a5eef074f14 service nova] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:40:53.592064 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.compute.server_external_events [req-c09463cf-c638-4741-aa95-42da10be3ead req-9d024fc9-d252-4944-bbce-3a5eef074f14 service nova] Creating event network-vif-plugged:248e29e3-d311-4074-bc03-c8c881428352 for instance e3dd8a17-5a2f-4f39-a110-208165e07110 on hv-cinder-80403 Jan 21 09:40:53.597073 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [req-c09463cf-c638-4741-aa95-42da10be3ead req-9d024fc9-d252-4944-bbce-3a5eef074f14 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034033 Jan 21 09:40:53.598419 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 419/842] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Jan 21 09:40:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 09:40:53.643111 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-d6be83e0-0195-458b-b47b-8d3e46444945 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:40:53.646960 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-d6be83e0-0195-458b-b47b-8d3e46444945 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] [instance: 9c18953a-7af3-4d71-97ad-05eda7e34a73] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:40:53.657729 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-d6be83e0-0195-458b-b47b-8d3e46444945 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:40:53.658240 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-d6be83e0-0195-458b-b47b-8d3e46444945 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:40:53.661471 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-d6be83e0-0195-458b-b47b-8d3e46444945 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:40:53.665726 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-d6be83e0-0195-458b-b47b-8d3e46444945 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:40:53.747441 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-d6be83e0-0195-458b-b47b-8d3e46444945 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] 10.222.0.45 "POST /compute/v2.1/servers/9c18953a-7af3-4d71-97ad-05eda7e34a73/action" status: 200 len: 31294 microversion: 2.1 time: 0.110965 Jan 21 09:40:53.748105 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 424/843] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Jan 21 09:40:53 2022] POST /compute/v2.1/servers/9c18953a-7af3-4d71-97ad-05eda7e34a73/action => generated 31294 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 21 09:40:54.490480 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-a37bce1a-46d2-42ea-9646-dfedc757c13b tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:40:54.490970 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-a37bce1a-46d2-42ea-9646-dfedc757c13b tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] [instance: e3dd8a17-5a2f-4f39-a110-208165e07110] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:40:54.497059 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-a37bce1a-46d2-42ea-9646-dfedc757c13b tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:40:54.497545 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-a37bce1a-46d2-42ea-9646-dfedc757c13b tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:40:54.498340 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-a37bce1a-46d2-42ea-9646-dfedc757c13b tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:40:54.498779 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-a37bce1a-46d2-42ea-9646-dfedc757c13b tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:40:54.642503 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-a37bce1a-46d2-42ea-9646-dfedc757c13b tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:40:54.651047 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-a37bce1a-46d2-42ea-9646-dfedc757c13b tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:40:54.652610 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-a37bce1a-46d2-42ea-9646-dfedc757c13b tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:40:54.653677 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-a37bce1a-46d2-42ea-9646-dfedc757c13b tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "GET /compute/v2.1/servers/e3dd8a17-5a2f-4f39-a110-208165e07110" status: 200 len: 1406 microversion: 2.20 time: 0.168061 Jan 21 09:40:54.654261 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 420/844] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jan 21 09:40:54 2022] GET /compute/v2.1/servers/e3dd8a17-5a2f-4f39-a110-208165e07110 => generated 1406 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 21 09:40:54.761088 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-2040acd9-7539-4cc1-b4ef-766b9461ac2c tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:40:54.762250 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-2040acd9-7539-4cc1-b4ef-766b9461ac2c tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] [instance: 9c18953a-7af3-4d71-97ad-05eda7e34a73] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:40:54.769870 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-2040acd9-7539-4cc1-b4ef-766b9461ac2c tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:40:54.770312 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-2040acd9-7539-4cc1-b4ef-766b9461ac2c tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:40:54.771114 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-2040acd9-7539-4cc1-b4ef-766b9461ac2c tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:40:54.771550 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-2040acd9-7539-4cc1-b4ef-766b9461ac2c tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:40:54.850557 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-2040acd9-7539-4cc1-b4ef-766b9461ac2c tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] 10.222.0.45 "POST /compute/v2.1/servers/9c18953a-7af3-4d71-97ad-05eda7e34a73/action" status: 200 len: 32508 microversion: 2.1 time: 0.093368 Jan 21 09:40:54.851270 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 425/845] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Jan 21 09:40:54 2022] POST /compute/v2.1/servers/9c18953a-7af3-4d71-97ad-05eda7e34a73/action => generated 32508 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 21 09:40:55.671645 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-7750d9ca-d720-4754-88ec-7052698c4be9 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:40:55.672245 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-7750d9ca-d720-4754-88ec-7052698c4be9 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] [instance: e3dd8a17-5a2f-4f39-a110-208165e07110] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:40:55.679296 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-7750d9ca-d720-4754-88ec-7052698c4be9 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:40:55.679742 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-7750d9ca-d720-4754-88ec-7052698c4be9 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:40:55.680557 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-7750d9ca-d720-4754-88ec-7052698c4be9 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:40:55.680991 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-7750d9ca-d720-4754-88ec-7052698c4be9 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:40:55.819083 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-7750d9ca-d720-4754-88ec-7052698c4be9 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:40:55.827184 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-7750d9ca-d720-4754-88ec-7052698c4be9 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:40:55.828685 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-7750d9ca-d720-4754-88ec-7052698c4be9 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:40:55.829964 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-7750d9ca-d720-4754-88ec-7052698c4be9 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "GET /compute/v2.1/servers/e3dd8a17-5a2f-4f39-a110-208165e07110" status: 200 len: 1599 microversion: 2.20 time: 0.162052 Jan 21 09:40:55.830529 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 421/846] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jan 21 09:40:55 2022] GET /compute/v2.1/servers/e3dd8a17-5a2f-4f39-a110-208165e07110 => generated 1599 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 21 09:40:55.848871 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-13b9e5da-409e-45f2-86a9-a6b3f61f5e39 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:40:55.849873 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-13b9e5da-409e-45f2-86a9-a6b3f61f5e39 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] [instance: e3dd8a17-5a2f-4f39-a110-208165e07110] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:40:55.856761 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-13b9e5da-409e-45f2-86a9-a6b3f61f5e39 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:40:55.857239 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-13b9e5da-409e-45f2-86a9-a6b3f61f5e39 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:40:55.858071 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-13b9e5da-409e-45f2-86a9-a6b3f61f5e39 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:40:55.858535 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-13b9e5da-409e-45f2-86a9-a6b3f61f5e39 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:40:55.864134 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-8727cfca-43fe-4f70-bc17-0ab361d8ffc4 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:40:55.865085 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-8727cfca-43fe-4f70-bc17-0ab361d8ffc4 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] [instance: 9c18953a-7af3-4d71-97ad-05eda7e34a73] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:40:55.871293 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-8727cfca-43fe-4f70-bc17-0ab361d8ffc4 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:40:55.871789 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-8727cfca-43fe-4f70-bc17-0ab361d8ffc4 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:40:55.872805 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-8727cfca-43fe-4f70-bc17-0ab361d8ffc4 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:40:55.873279 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-8727cfca-43fe-4f70-bc17-0ab361d8ffc4 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:40:55.947017 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-13b9e5da-409e-45f2-86a9-a6b3f61f5e39 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "GET /compute/v2.1/servers/e3dd8a17-5a2f-4f39-a110-208165e07110/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.102527 Jan 21 09:40:55.947633 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 426/847] 10.222.0.45 () {60 vars in 1315 bytes} [Fri Jan 21 09:40:55 2022] GET /compute/v2.1/servers/e3dd8a17-5a2f-4f39-a110-208165e07110/os-interface => generated 285 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 21 09:40:55.953251 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-8727cfca-43fe-4f70-bc17-0ab361d8ffc4 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] 10.222.0.45 "POST /compute/v2.1/servers/9c18953a-7af3-4d71-97ad-05eda7e34a73/action" status: 200 len: 33349 microversion: 2.1 time: 0.093797 Jan 21 09:40:55.954309 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 422/848] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Jan 21 09:40:55 2022] POST /compute/v2.1/servers/9c18953a-7af3-4d71-97ad-05eda7e34a73/action => generated 33349 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 21 09:40:56.964755 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-47acc09e-b35f-4b7b-a29b-15c53242ff31 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:40:56.966781 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-47acc09e-b35f-4b7b-a29b-15c53242ff31 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] [instance: 9c18953a-7af3-4d71-97ad-05eda7e34a73] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:40:56.974073 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-47acc09e-b35f-4b7b-a29b-15c53242ff31 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:40:56.974789 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-47acc09e-b35f-4b7b-a29b-15c53242ff31 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:40:56.975755 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-47acc09e-b35f-4b7b-a29b-15c53242ff31 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:40:56.976190 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-47acc09e-b35f-4b7b-a29b-15c53242ff31 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:40:57.061238 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-47acc09e-b35f-4b7b-a29b-15c53242ff31 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] 10.222.0.45 "POST /compute/v2.1/servers/9c18953a-7af3-4d71-97ad-05eda7e34a73/action" status: 200 len: 34069 microversion: 2.1 time: 0.099695 Jan 21 09:40:57.062541 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 427/849] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Jan 21 09:40:56 2022] POST /compute/v2.1/servers/9c18953a-7af3-4d71-97ad-05eda7e34a73/action => generated 34069 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 21 09:40:57.240974 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-4f61d2b6-3662-47b6-85a3-94e668ae38a0 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:40:57.242122 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-4f61d2b6-3662-47b6-85a3-94e668ae38a0 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] [instance: e3dd8a17-5a2f-4f39-a110-208165e07110] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:40:57.243090 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [req-634d805f-4ae2-4fce-a60f-04716a6c71a5 req-bd807c40-b853-4db0-b4f1-3e2886318826 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e3dd8a17-5a2f-4f39-a110-208165e07110", "tag": "248e29e3-d311-4074-bc03-c8c881428352"}]} {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:40:57.244904 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 21 09:40:57.244904 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: warnings.warn(msg) Jan 21 09:40:57.249026 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-4f61d2b6-3662-47b6-85a3-94e668ae38a0 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:40:57.250063 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-4f61d2b6-3662-47b6-85a3-94e668ae38a0 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:40:57.251095 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-4f61d2b6-3662-47b6-85a3-94e668ae38a0 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:40:57.251743 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-4f61d2b6-3662-47b6-85a3-94e668ae38a0 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:40:57.255645 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [req-634d805f-4ae2-4fce-a60f-04716a6c71a5 req-bd807c40-b853-4db0-b4f1-3e2886318826 service nova] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:40:57.256109 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [req-634d805f-4ae2-4fce-a60f-04716a6c71a5 req-bd807c40-b853-4db0-b4f1-3e2886318826 service nova] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:40:57.268543 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.compute.server_external_events [req-634d805f-4ae2-4fce-a60f-04716a6c71a5 req-bd807c40-b853-4db0-b4f1-3e2886318826 service nova] Creating event network-changed:248e29e3-d311-4074-bc03-c8c881428352 for instance e3dd8a17-5a2f-4f39-a110-208165e07110 on hv-cinder-80403 Jan 21 09:40:57.275970 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [req-634d805f-4ae2-4fce-a60f-04716a6c71a5 req-bd807c40-b853-4db0-b4f1-3e2886318826 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038357 Jan 21 09:40:57.276601 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 428/850] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Jan 21 09:40:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 21 09:40:57.327711 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-4f61d2b6-3662-47b6-85a3-94e668ae38a0 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "POST /compute/v2.1/servers/e3dd8a17-5a2f-4f39-a110-208165e07110/action" status: 200 len: 14 microversion: 2.20 time: 0.092728 Jan 21 09:40:57.328358 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 423/851] 10.222.0.45 () {62 vars in 1318 bytes} [Fri Jan 21 09:40:57 2022] POST /compute/v2.1/servers/e3dd8a17-5a2f-4f39-a110-208165e07110/action => generated 14 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:40:58.074629 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-e0761d48-a7af-4d7d-9543-31a974f1ddd2 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:40:58.075547 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-e0761d48-a7af-4d7d-9543-31a974f1ddd2 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] [instance: 9c18953a-7af3-4d71-97ad-05eda7e34a73] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:40:58.082918 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-e0761d48-a7af-4d7d-9543-31a974f1ddd2 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:40:58.083538 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-e0761d48-a7af-4d7d-9543-31a974f1ddd2 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:40:58.084368 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-e0761d48-a7af-4d7d-9543-31a974f1ddd2 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:40:58.084806 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-e0761d48-a7af-4d7d-9543-31a974f1ddd2 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:40:58.167308 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-e0761d48-a7af-4d7d-9543-31a974f1ddd2 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] 10.222.0.45 "POST /compute/v2.1/servers/9c18953a-7af3-4d71-97ad-05eda7e34a73/action" status: 200 len: 34876 microversion: 2.1 time: 0.097156 Jan 21 09:40:58.167987 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 429/852] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Jan 21 09:40:58 2022] POST /compute/v2.1/servers/9c18953a-7af3-4d71-97ad-05eda7e34a73/action => generated 34876 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 21 09:40:58.339467 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-34b49eaa-8337-41bc-a104-5ca29885bc51 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:40:58.340367 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-34b49eaa-8337-41bc-a104-5ca29885bc51 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] [instance: e3dd8a17-5a2f-4f39-a110-208165e07110] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:40:58.348289 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-34b49eaa-8337-41bc-a104-5ca29885bc51 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:40:58.348764 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-34b49eaa-8337-41bc-a104-5ca29885bc51 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:40:58.349582 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-34b49eaa-8337-41bc-a104-5ca29885bc51 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:40:58.350014 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-34b49eaa-8337-41bc-a104-5ca29885bc51 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:40:58.422539 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-34b49eaa-8337-41bc-a104-5ca29885bc51 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "POST /compute/v2.1/servers/e3dd8a17-5a2f-4f39-a110-208165e07110/action" status: 200 len: 14 microversion: 2.20 time: 0.086973 Jan 21 09:40:58.423211 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 424/853] 10.222.0.45 () {62 vars in 1318 bytes} [Fri Jan 21 09:40:58 2022] POST /compute/v2.1/servers/e3dd8a17-5a2f-4f39-a110-208165e07110/action => generated 14 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 09:40:59.181561 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-7c823c80-05db-4d5a-8f65-bd892a44a0c1 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:40:59.182550 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-7c823c80-05db-4d5a-8f65-bd892a44a0c1 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] [instance: 9c18953a-7af3-4d71-97ad-05eda7e34a73] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:40:59.189449 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-7c823c80-05db-4d5a-8f65-bd892a44a0c1 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:40:59.189892 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-7c823c80-05db-4d5a-8f65-bd892a44a0c1 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:40:59.190665 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-7c823c80-05db-4d5a-8f65-bd892a44a0c1 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:40:59.191732 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-7c823c80-05db-4d5a-8f65-bd892a44a0c1 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:40:59.269923 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-7c823c80-05db-4d5a-8f65-bd892a44a0c1 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] 10.222.0.45 "POST /compute/v2.1/servers/9c18953a-7af3-4d71-97ad-05eda7e34a73/action" status: 200 len: 35702 microversion: 2.1 time: 0.092975 Jan 21 09:40:59.270586 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 430/854] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Jan 21 09:40:59 2022] POST /compute/v2.1/servers/9c18953a-7af3-4d71-97ad-05eda7e34a73/action => generated 35702 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 21 09:40:59.434414 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-8ac14527-4dd8-4d7b-8c62-1013eaf1f82f tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:40:59.435704 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-8ac14527-4dd8-4d7b-8c62-1013eaf1f82f tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] [instance: e3dd8a17-5a2f-4f39-a110-208165e07110] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:40:59.443207 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-8ac14527-4dd8-4d7b-8c62-1013eaf1f82f tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:40:59.443655 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-8ac14527-4dd8-4d7b-8c62-1013eaf1f82f tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:40:59.444444 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-8ac14527-4dd8-4d7b-8c62-1013eaf1f82f tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:40:59.444880 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-8ac14527-4dd8-4d7b-8c62-1013eaf1f82f tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:40:59.512178 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-8ac14527-4dd8-4d7b-8c62-1013eaf1f82f tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "POST /compute/v2.1/servers/e3dd8a17-5a2f-4f39-a110-208165e07110/action" status: 200 len: 14 microversion: 2.20 time: 0.081641 Jan 21 09:40:59.515525 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 425/855] 10.222.0.45 () {62 vars in 1318 bytes} [Fri Jan 21 09:40:59 2022] POST /compute/v2.1/servers/e3dd8a17-5a2f-4f39-a110-208165e07110/action => generated 14 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 09:41:00.282352 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-ccb1c3a7-2811-433a-9452-a5908951ec95 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:41:00.283336 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-ccb1c3a7-2811-433a-9452-a5908951ec95 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] [instance: 9c18953a-7af3-4d71-97ad-05eda7e34a73] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:41:00.290163 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-ccb1c3a7-2811-433a-9452-a5908951ec95 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:41:00.290643 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-ccb1c3a7-2811-433a-9452-a5908951ec95 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:41:00.291424 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-ccb1c3a7-2811-433a-9452-a5908951ec95 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:41:00.291851 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-ccb1c3a7-2811-433a-9452-a5908951ec95 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:41:00.369420 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-ccb1c3a7-2811-433a-9452-a5908951ec95 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] 10.222.0.45 "POST /compute/v2.1/servers/9c18953a-7af3-4d71-97ad-05eda7e34a73/action" status: 200 len: 36758 microversion: 2.1 time: 0.090817 Jan 21 09:41:00.369991 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 431/856] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Jan 21 09:41:00 2022] POST /compute/v2.1/servers/9c18953a-7af3-4d71-97ad-05eda7e34a73/action => generated 36758 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 21 09:41:00.524785 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-1d284631-502a-4138-a74d-387dc4d86b72 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:41:00.525854 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-1d284631-502a-4138-a74d-387dc4d86b72 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] [instance: e3dd8a17-5a2f-4f39-a110-208165e07110] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:41:00.536197 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-1d284631-502a-4138-a74d-387dc4d86b72 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:41:00.540132 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-1d284631-502a-4138-a74d-387dc4d86b72 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:41:00.540132 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-1d284631-502a-4138-a74d-387dc4d86b72 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:41:00.540132 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-1d284631-502a-4138-a74d-387dc4d86b72 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:41:00.603163 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-1d284631-502a-4138-a74d-387dc4d86b72 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "POST /compute/v2.1/servers/e3dd8a17-5a2f-4f39-a110-208165e07110/action" status: 200 len: 14 microversion: 2.20 time: 0.083071 Jan 21 09:41:00.603965 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 426/857] 10.222.0.45 () {62 vars in 1318 bytes} [Fri Jan 21 09:41:00 2022] POST /compute/v2.1/servers/e3dd8a17-5a2f-4f39-a110-208165e07110/action => generated 14 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:41:01.382364 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-f99703a4-96e3-4e1b-8d17-f5cb15408e39 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:41:01.383347 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-f99703a4-96e3-4e1b-8d17-f5cb15408e39 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] [instance: 9c18953a-7af3-4d71-97ad-05eda7e34a73] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:41:01.390194 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-f99703a4-96e3-4e1b-8d17-f5cb15408e39 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:41:01.390643 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-f99703a4-96e3-4e1b-8d17-f5cb15408e39 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:41:01.391421 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-f99703a4-96e3-4e1b-8d17-f5cb15408e39 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:41:01.391851 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-f99703a4-96e3-4e1b-8d17-f5cb15408e39 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:41:01.470507 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-f99703a4-96e3-4e1b-8d17-f5cb15408e39 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] 10.222.0.45 "POST /compute/v2.1/servers/9c18953a-7af3-4d71-97ad-05eda7e34a73/action" status: 200 len: 38162 microversion: 2.1 time: 0.092637 Jan 21 09:41:01.471277 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 432/858] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Jan 21 09:41:01 2022] POST /compute/v2.1/servers/9c18953a-7af3-4d71-97ad-05eda7e34a73/action => generated 38162 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 21 09:41:01.615203 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-5b6f6eb4-b21a-42f2-adb0-4079f366fbae tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:41:01.616212 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-5b6f6eb4-b21a-42f2-adb0-4079f366fbae tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] [instance: e3dd8a17-5a2f-4f39-a110-208165e07110] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:41:01.623218 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-5b6f6eb4-b21a-42f2-adb0-4079f366fbae tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:41:01.623674 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-5b6f6eb4-b21a-42f2-adb0-4079f366fbae tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:41:01.624462 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-5b6f6eb4-b21a-42f2-adb0-4079f366fbae tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:41:01.624905 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-5b6f6eb4-b21a-42f2-adb0-4079f366fbae tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:41:01.687360 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-5b6f6eb4-b21a-42f2-adb0-4079f366fbae tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "POST /compute/v2.1/servers/e3dd8a17-5a2f-4f39-a110-208165e07110/action" status: 200 len: 14 microversion: 2.20 time: 0.077038 Jan 21 09:41:01.688003 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 427/859] 10.222.0.45 () {62 vars in 1318 bytes} [Fri Jan 21 09:41:01 2022] POST /compute/v2.1/servers/e3dd8a17-5a2f-4f39-a110-208165e07110/action => generated 14 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:41:02.483976 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-56398c3e-8343-4202-8bbd-c47f3806c930 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:41:02.486012 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-56398c3e-8343-4202-8bbd-c47f3806c930 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] [instance: 9c18953a-7af3-4d71-97ad-05eda7e34a73] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:41:02.497992 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-56398c3e-8343-4202-8bbd-c47f3806c930 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:41:02.498795 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-56398c3e-8343-4202-8bbd-c47f3806c930 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:41:02.500203 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-56398c3e-8343-4202-8bbd-c47f3806c930 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:41:02.501097 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-56398c3e-8343-4202-8bbd-c47f3806c930 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:41:02.601874 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-56398c3e-8343-4202-8bbd-c47f3806c930 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] 10.222.0.45 "POST /compute/v2.1/servers/9c18953a-7af3-4d71-97ad-05eda7e34a73/action" status: 200 len: 38164 microversion: 2.1 time: 0.122880 Jan 21 09:41:02.602553 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 433/860] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Jan 21 09:41:02 2022] POST /compute/v2.1/servers/9c18953a-7af3-4d71-97ad-05eda7e34a73/action => generated 38164 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 21 09:41:02.699130 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-df3e0373-501c-4d5b-a375-dd15cd15f550 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:41:02.700123 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-df3e0373-501c-4d5b-a375-dd15cd15f550 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] [instance: e3dd8a17-5a2f-4f39-a110-208165e07110] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:41:02.707321 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-df3e0373-501c-4d5b-a375-dd15cd15f550 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:41:02.707557 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-df3e0373-501c-4d5b-a375-dd15cd15f550 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:41:02.708259 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-df3e0373-501c-4d5b-a375-dd15cd15f550 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:41:02.708690 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-df3e0373-501c-4d5b-a375-dd15cd15f550 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:41:02.772492 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-df3e0373-501c-4d5b-a375-dd15cd15f550 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "POST /compute/v2.1/servers/e3dd8a17-5a2f-4f39-a110-208165e07110/action" status: 200 len: 14 microversion: 2.20 time: 0.076918 Jan 21 09:41:02.772736 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 428/861] 10.222.0.45 () {62 vars in 1318 bytes} [Fri Jan 21 09:41:02 2022] POST /compute/v2.1/servers/e3dd8a17-5a2f-4f39-a110-208165e07110/action => generated 14 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:41:03.615967 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-d1fef7e7-2d59-4085-8af6-c83daa5ed59a tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:41:03.616874 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-d1fef7e7-2d59-4085-8af6-c83daa5ed59a tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] [instance: 9c18953a-7af3-4d71-97ad-05eda7e34a73] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:41:03.623769 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-d1fef7e7-2d59-4085-8af6-c83daa5ed59a tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:41:03.624224 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-d1fef7e7-2d59-4085-8af6-c83daa5ed59a tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:41:03.625015 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-d1fef7e7-2d59-4085-8af6-c83daa5ed59a tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:41:03.625481 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-d1fef7e7-2d59-4085-8af6-c83daa5ed59a tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:41:03.688089 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-d1fef7e7-2d59-4085-8af6-c83daa5ed59a tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] 10.222.0.45 "POST /compute/v2.1/servers/9c18953a-7af3-4d71-97ad-05eda7e34a73/action" status: 200 len: 38164 microversion: 2.1 time: 0.077243 Jan 21 09:41:03.688737 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 434/862] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Jan 21 09:41:03 2022] POST /compute/v2.1/servers/9c18953a-7af3-4d71-97ad-05eda7e34a73/action => generated 38164 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 21 09:41:03.783990 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-6c39c9b8-31ce-42a2-ac71-3bd1a194d9ae tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:41:03.786205 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-6c39c9b8-31ce-42a2-ac71-3bd1a194d9ae tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] [instance: e3dd8a17-5a2f-4f39-a110-208165e07110] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:41:03.795370 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-6c39c9b8-31ce-42a2-ac71-3bd1a194d9ae tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:41:03.795822 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-6c39c9b8-31ce-42a2-ac71-3bd1a194d9ae tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:41:03.796623 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-6c39c9b8-31ce-42a2-ac71-3bd1a194d9ae tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:41:03.797064 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-6c39c9b8-31ce-42a2-ac71-3bd1a194d9ae tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:41:03.854480 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-6c39c9b8-31ce-42a2-ac71-3bd1a194d9ae tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "POST /compute/v2.1/servers/e3dd8a17-5a2f-4f39-a110-208165e07110/action" status: 200 len: 14 microversion: 2.20 time: 0.074399 Jan 21 09:41:03.855185 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 429/863] 10.222.0.45 () {62 vars in 1318 bytes} [Fri Jan 21 09:41:03 2022] POST /compute/v2.1/servers/e3dd8a17-5a2f-4f39-a110-208165e07110/action => generated 14 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:41:03.929173 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-63935bc0-a8b1-46da-bd7b-47e2db9c6079 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-71706229"}} {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:41:03.929800 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-63935bc0-a8b1-46da-bd7b-47e2db9c6079 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] [instance: 750f8ae5-b267-4b76-bb13-170071722932] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:41:03.936607 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-63935bc0-a8b1-46da-bd7b-47e2db9c6079 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:41:03.937119 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-63935bc0-a8b1-46da-bd7b-47e2db9c6079 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:41:03.937944 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-63935bc0-a8b1-46da-bd7b-47e2db9c6079 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:41:03.938371 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-63935bc0-a8b1-46da-bd7b-47e2db9c6079 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:41:04.072663 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.network.security_group_api [None req-63935bc0-a8b1-46da-bd7b-47e2db9c6079 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Removing security group 24c9a066-57df-44c0-a738-031af5f33ea2 from port d22f9cde-e9ce-4b37-9b2a-f673b65a0353 Jan 21 09:41:04.524461 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-63935bc0-a8b1-46da-bd7b-47e2db9c6079 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] 10.222.0.45 "POST /compute/v2.1/servers/750f8ae5-b267-4b76-bb13-170071722932/action" status: 202 len: 0 microversion: 2.1 time: 0.595170 Jan 21 09:41:04.527549 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 435/864] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Jan 21 09:41:03 2022] POST /compute/v2.1/servers/750f8ae5-b267-4b76-bb13-170071722932/action => generated 0 bytes in 604 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 21 09:41:04.531525 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [req-27393b6a-e62c-4e34-b098-5c3e017e9c5d req-afbae9b2-b696-425b-a490-3caececcedbf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "750f8ae5-b267-4b76-bb13-170071722932", "tag": "d22f9cde-e9ce-4b37-9b2a-f673b65a0353"}]} {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:41:04.533319 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 21 09:41:04.533319 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: warnings.warn(msg) Jan 21 09:41:04.543336 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [req-27393b6a-e62c-4e34-b098-5c3e017e9c5d req-afbae9b2-b696-425b-a490-3caececcedbf service nova] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:41:04.544108 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [req-27393b6a-e62c-4e34-b098-5c3e017e9c5d req-afbae9b2-b696-425b-a490-3caececcedbf service nova] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:41:04.569436 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.compute.server_external_events [req-27393b6a-e62c-4e34-b098-5c3e017e9c5d req-afbae9b2-b696-425b-a490-3caececcedbf service nova] Creating event network-changed:d22f9cde-e9ce-4b37-9b2a-f673b65a0353 for instance 750f8ae5-b267-4b76-bb13-170071722932 on hv-cinder-80403 Jan 21 09:41:04.576282 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [req-27393b6a-e62c-4e34-b098-5c3e017e9c5d req-afbae9b2-b696-425b-a490-3caececcedbf service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048851 Jan 21 09:41:04.577020 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 430/865] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Jan 21 09:41:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 21 09:41:04.700856 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-d74e70c8-e59e-49e3-b212-48f1b504ed66 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:41:04.702058 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-d74e70c8-e59e-49e3-b212-48f1b504ed66 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] [instance: 9c18953a-7af3-4d71-97ad-05eda7e34a73] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:41:04.712514 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-d74e70c8-e59e-49e3-b212-48f1b504ed66 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:41:04.713510 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-d74e70c8-e59e-49e3-b212-48f1b504ed66 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:41:04.714517 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-d74e70c8-e59e-49e3-b212-48f1b504ed66 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:41:04.715125 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-d74e70c8-e59e-49e3-b212-48f1b504ed66 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:41:04.787941 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-d74e70c8-e59e-49e3-b212-48f1b504ed66 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] 10.222.0.45 "POST /compute/v2.1/servers/9c18953a-7af3-4d71-97ad-05eda7e34a73/action" status: 200 len: 38164 microversion: 2.1 time: 0.090551 Jan 21 09:41:04.790165 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 436/866] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Jan 21 09:41:04 2022] POST /compute/v2.1/servers/9c18953a-7af3-4d71-97ad-05eda7e34a73/action => generated 38164 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 21 09:41:04.867812 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-dd263c07-9558-4002-bb33-9e98c9361ed8 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:41:04.870514 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-dd263c07-9558-4002-bb33-9e98c9361ed8 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] [instance: e3dd8a17-5a2f-4f39-a110-208165e07110] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:41:04.888992 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-dd263c07-9558-4002-bb33-9e98c9361ed8 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:41:04.889637 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-dd263c07-9558-4002-bb33-9e98c9361ed8 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:41:04.890715 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-dd263c07-9558-4002-bb33-9e98c9361ed8 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:41:04.891231 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-dd263c07-9558-4002-bb33-9e98c9361ed8 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:41:04.957864 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-dd263c07-9558-4002-bb33-9e98c9361ed8 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "POST /compute/v2.1/servers/e3dd8a17-5a2f-4f39-a110-208165e07110/action" status: 200 len: 14 microversion: 2.20 time: 0.094228 Jan 21 09:41:04.958524 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 431/867] 10.222.0.45 () {62 vars in 1318 bytes} [Fri Jan 21 09:41:04 2022] POST /compute/v2.1/servers/e3dd8a17-5a2f-4f39-a110-208165e07110/action => generated 14 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:41:05.801297 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-8c205a4a-0b73-4c76-a2fb-9cebba690aae tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:41:05.802499 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-8c205a4a-0b73-4c76-a2fb-9cebba690aae tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] [instance: 9c18953a-7af3-4d71-97ad-05eda7e34a73] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:41:05.809696 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-8c205a4a-0b73-4c76-a2fb-9cebba690aae tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:41:05.810146 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-8c205a4a-0b73-4c76-a2fb-9cebba690aae tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:41:05.810947 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-8c205a4a-0b73-4c76-a2fb-9cebba690aae tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:41:05.811389 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-8c205a4a-0b73-4c76-a2fb-9cebba690aae tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:41:05.886404 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-8c205a4a-0b73-4c76-a2fb-9cebba690aae tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] 10.222.0.45 "POST /compute/v2.1/servers/9c18953a-7af3-4d71-97ad-05eda7e34a73/action" status: 200 len: 38295 microversion: 2.1 time: 0.089632 Jan 21 09:41:05.887596 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 437/868] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Jan 21 09:41:05 2022] POST /compute/v2.1/servers/9c18953a-7af3-4d71-97ad-05eda7e34a73/action => generated 38295 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 21 09:41:05.900646 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-d8ff04dc-4caa-43c0-8583-af419d42e001 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:41:05.901424 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-d8ff04dc-4caa-43c0-8583-af419d42e001 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] [instance: 9c18953a-7af3-4d71-97ad-05eda7e34a73] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:41:05.908739 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-d8ff04dc-4caa-43c0-8583-af419d42e001 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:41:05.909209 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-d8ff04dc-4caa-43c0-8583-af419d42e001 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:41:05.910804 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-d8ff04dc-4caa-43c0-8583-af419d42e001 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:41:05.911394 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-d8ff04dc-4caa-43c0-8583-af419d42e001 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:41:05.936677 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-d8ff04dc-4caa-43c0-8583-af419d42e001 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] 10.222.0.45 "GET /compute/v2.1/servers/9c18953a-7af3-4d71-97ad-05eda7e34a73/ips" status: 200 len: 147 microversion: 2.1 time: 0.040757 Jan 21 09:41:05.937293 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 432/869] 10.222.0.45 () {58 vars in 1247 bytes} [Fri Jan 21 09:41:05 2022] GET /compute/v2.1/servers/9c18953a-7af3-4d71-97ad-05eda7e34a73/ips => generated 147 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 09:41:05.968634 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-e695cc05-9e30-42a9-8bb8-8ea16b51b17d tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:41:05.969653 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-e695cc05-9e30-42a9-8bb8-8ea16b51b17d tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] [instance: e3dd8a17-5a2f-4f39-a110-208165e07110] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:41:05.977322 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-e695cc05-9e30-42a9-8bb8-8ea16b51b17d tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:41:05.980343 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-e695cc05-9e30-42a9-8bb8-8ea16b51b17d tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:41:05.980343 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-e695cc05-9e30-42a9-8bb8-8ea16b51b17d tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:41:05.980343 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-e695cc05-9e30-42a9-8bb8-8ea16b51b17d tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:41:06.044406 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-e695cc05-9e30-42a9-8bb8-8ea16b51b17d tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "POST /compute/v2.1/servers/e3dd8a17-5a2f-4f39-a110-208165e07110/action" status: 200 len: 14 microversion: 2.20 time: 0.079654 Jan 21 09:41:06.047661 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 438/870] 10.222.0.45 () {62 vars in 1318 bytes} [Fri Jan 21 09:41:05 2022] POST /compute/v2.1/servers/e3dd8a17-5a2f-4f39-a110-208165e07110/action => generated 14 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:41:06.060367 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [req-9ed98445-b425-4c35-93e5-1bbf3d00d831 req-7824ad83-0f94-48b3-b492-79c32b6adda0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "750f8ae5-b267-4b76-bb13-170071722932", "tag": "d22f9cde-e9ce-4b37-9b2a-f673b65a0353"}]} {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:41:06.061308 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-092f51d8-b0a3-451d-afff-20c30b6337ec tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:41:06.061909 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 21 09:41:06.061909 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: warnings.warn(msg) Jan 21 09:41:06.062116 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-092f51d8-b0a3-451d-afff-20c30b6337ec tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] [instance: 750f8ae5-b267-4b76-bb13-170071722932] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:41:06.070772 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-092f51d8-b0a3-451d-afff-20c30b6337ec tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:41:06.071476 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [req-9ed98445-b425-4c35-93e5-1bbf3d00d831 req-7824ad83-0f94-48b3-b492-79c32b6adda0 service nova] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:41:06.071628 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-092f51d8-b0a3-451d-afff-20c30b6337ec tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:41:06.071932 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [req-9ed98445-b425-4c35-93e5-1bbf3d00d831 req-7824ad83-0f94-48b3-b492-79c32b6adda0 service nova] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:41:06.072756 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-092f51d8-b0a3-451d-afff-20c30b6337ec tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:41:06.073216 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-092f51d8-b0a3-451d-afff-20c30b6337ec tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:41:06.085295 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.compute.server_external_events [req-9ed98445-b425-4c35-93e5-1bbf3d00d831 req-7824ad83-0f94-48b3-b492-79c32b6adda0 service nova] Creating event network-changed:d22f9cde-e9ce-4b37-9b2a-f673b65a0353 for instance 750f8ae5-b267-4b76-bb13-170071722932 on hv-cinder-80403 Jan 21 09:41:06.095552 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [req-9ed98445-b425-4c35-93e5-1bbf3d00d831 req-7824ad83-0f94-48b3-b492-79c32b6adda0 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039005 Jan 21 09:41:06.096157 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 439/871] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Jan 21 09:41:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 09:41:06.196161 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.objects.instance [None req-092f51d8-b0a3-451d-afff-20c30b6337ec tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Lazy-loading 'services' on Instance uuid 750f8ae5-b267-4b76-bb13-170071722932 {{(pid=123386) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 21 09:41:06.424491 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-092f51d8-b0a3-451d-afff-20c30b6337ec tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] 10.222.0.45 "DELETE /compute/v2.1/servers/750f8ae5-b267-4b76-bb13-170071722932/os-volume_attachments/6d0f7122-1337-488c-93ba-3fdc77d1378e" status: 202 len: 0 microversion: 2.1 time: 0.368061 Jan 21 09:41:06.426058 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 433/872] 10.222.0.45 () {58 vars in 1415 bytes} [Fri Jan 21 09:41:06 2022] DELETE /compute/v2.1/servers/750f8ae5-b267-4b76-bb13-170071722932/os-volume_attachments/6d0f7122-1337-488c-93ba-3fdc77d1378e => generated 0 bytes in 370 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 21 09:41:06.434845 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-b4ecb789-da6b-4b46-b198-5fe9b57e1677 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:41:06.436283 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-b4ecb789-da6b-4b46-b198-5fe9b57e1677 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] [instance: 750f8ae5-b267-4b76-bb13-170071722932] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:41:06.443769 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-b4ecb789-da6b-4b46-b198-5fe9b57e1677 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:41:06.444320 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-b4ecb789-da6b-4b46-b198-5fe9b57e1677 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:41:06.444999 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-b4ecb789-da6b-4b46-b198-5fe9b57e1677 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:41:06.445489 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-b4ecb789-da6b-4b46-b198-5fe9b57e1677 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:41:06.479584 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-b4ecb789-da6b-4b46-b198-5fe9b57e1677 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] 10.222.0.45 "GET /compute/v2.1/servers/750f8ae5-b267-4b76-bb13-170071722932/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049551 Jan 21 09:41:06.480804 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 440/873] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Jan 21 09:41:06 2022] GET /compute/v2.1/servers/750f8ae5-b267-4b76-bb13-170071722932/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 09:41:07.059292 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-2d0897d1-e225-4756-bafc-ce45e4f89e8d tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:41:07.060279 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-2d0897d1-e225-4756-bafc-ce45e4f89e8d tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] [instance: e3dd8a17-5a2f-4f39-a110-208165e07110] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:41:07.068528 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-2d0897d1-e225-4756-bafc-ce45e4f89e8d tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:41:07.068856 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-2d0897d1-e225-4756-bafc-ce45e4f89e8d tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:41:07.069695 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-2d0897d1-e225-4756-bafc-ce45e4f89e8d tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:41:07.070294 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-2d0897d1-e225-4756-bafc-ce45e4f89e8d tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:41:07.135389 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-2d0897d1-e225-4756-bafc-ce45e4f89e8d tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "POST /compute/v2.1/servers/e3dd8a17-5a2f-4f39-a110-208165e07110/action" status: 200 len: 14 microversion: 2.20 time: 0.082107 Jan 21 09:41:07.136113 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 434/874] 10.222.0.45 () {62 vars in 1318 bytes} [Fri Jan 21 09:41:07 2022] POST /compute/v2.1/servers/e3dd8a17-5a2f-4f39-a110-208165e07110/action => generated 14 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 09:41:07.493296 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-e4501d54-413c-4f9b-9602-448ac39d0449 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:41:07.494211 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-e4501d54-413c-4f9b-9602-448ac39d0449 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] [instance: 750f8ae5-b267-4b76-bb13-170071722932] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:41:07.500714 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-e4501d54-413c-4f9b-9602-448ac39d0449 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:41:07.501309 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-e4501d54-413c-4f9b-9602-448ac39d0449 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:41:07.501991 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-e4501d54-413c-4f9b-9602-448ac39d0449 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:41:07.502426 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-e4501d54-413c-4f9b-9602-448ac39d0449 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:41:07.537395 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-e4501d54-413c-4f9b-9602-448ac39d0449 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] 10.222.0.45 "GET /compute/v2.1/servers/750f8ae5-b267-4b76-bb13-170071722932/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047744 Jan 21 09:41:07.538446 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 441/875] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Jan 21 09:41:07 2022] GET /compute/v2.1/servers/750f8ae5-b267-4b76-bb13-170071722932/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 09:41:08.149458 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-b3953de9-f3d4-4b87-b9ac-dccd898384b6 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:41:08.153232 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-b3953de9-f3d4-4b87-b9ac-dccd898384b6 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] [instance: e3dd8a17-5a2f-4f39-a110-208165e07110] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:41:08.157567 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-b3953de9-f3d4-4b87-b9ac-dccd898384b6 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:41:08.158020 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-b3953de9-f3d4-4b87-b9ac-dccd898384b6 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:41:08.158815 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-b3953de9-f3d4-4b87-b9ac-dccd898384b6 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:41:08.159344 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-b3953de9-f3d4-4b87-b9ac-dccd898384b6 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:41:08.233402 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-b3953de9-f3d4-4b87-b9ac-dccd898384b6 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "POST /compute/v2.1/servers/e3dd8a17-5a2f-4f39-a110-208165e07110/action" status: 200 len: 14 microversion: 2.20 time: 0.088829 Jan 21 09:41:08.234047 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 435/876] 10.222.0.45 () {62 vars in 1318 bytes} [Fri Jan 21 09:41:08 2022] POST /compute/v2.1/servers/e3dd8a17-5a2f-4f39-a110-208165e07110/action => generated 14 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:41:08.550513 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-58342f94-de87-4b89-b72c-7ad64946fb02 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:41:08.558000 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-58342f94-de87-4b89-b72c-7ad64946fb02 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] [instance: 750f8ae5-b267-4b76-bb13-170071722932] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:41:08.558340 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-58342f94-de87-4b89-b72c-7ad64946fb02 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:41:08.558756 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-58342f94-de87-4b89-b72c-7ad64946fb02 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:41:08.559943 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-58342f94-de87-4b89-b72c-7ad64946fb02 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:41:08.560382 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-58342f94-de87-4b89-b72c-7ad64946fb02 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:41:08.597049 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-58342f94-de87-4b89-b72c-7ad64946fb02 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] 10.222.0.45 "GET /compute/v2.1/servers/750f8ae5-b267-4b76-bb13-170071722932/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050510 Jan 21 09:41:08.598030 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 442/877] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Jan 21 09:41:08 2022] GET /compute/v2.1/servers/750f8ae5-b267-4b76-bb13-170071722932/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 21 09:41:08.611750 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-308e127d-c2f1-4b89-895c-439107a5f2fd tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:41:08.611750 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-308e127d-c2f1-4b89-895c-439107a5f2fd tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] [instance: 750f8ae5-b267-4b76-bb13-170071722932] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:41:08.620899 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-308e127d-c2f1-4b89-895c-439107a5f2fd tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:41:08.621406 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-308e127d-c2f1-4b89-895c-439107a5f2fd tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:41:08.622208 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-308e127d-c2f1-4b89-895c-439107a5f2fd tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:41:08.622644 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-308e127d-c2f1-4b89-895c-439107a5f2fd tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:41:08.714296 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.wsgi [None req-308e127d-c2f1-4b89-895c-439107a5f2fd tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] HTTP exception thrown: Instance 750f8ae5-b267-4b76-bb13-170071722932 is not attached to volume 6d0f7122-1337-488c-93ba-3fdc77d1378e Jan 21 09:41:08.714972 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-308e127d-c2f1-4b89-895c-439107a5f2fd tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Returning 404 to user: Instance 750f8ae5-b267-4b76-bb13-170071722932 is not attached to volume 6d0f7122-1337-488c-93ba-3fdc77d1378e {{(pid=123386) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 21 09:41:08.715806 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-308e127d-c2f1-4b89-895c-439107a5f2fd tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] 10.222.0.45 "DELETE /compute/v2.1/servers/750f8ae5-b267-4b76-bb13-170071722932/os-volume_attachments/6d0f7122-1337-488c-93ba-3fdc77d1378e" status: 404 len: 154 microversion: 2.1 time: 0.109485 Jan 21 09:41:08.717087 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 436/878] 10.222.0.45 () {58 vars in 1415 bytes} [Fri Jan 21 09:41:08 2022] DELETE /compute/v2.1/servers/750f8ae5-b267-4b76-bb13-170071722932/os-volume_attachments/6d0f7122-1337-488c-93ba-3fdc77d1378e => generated 154 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 21 09:41:08.792648 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-503ac114-6b2b-4c57-855d-f88d501c7cf3 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1e5587e1-adfd-485f-b9b8-394104580c61"}} {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:41:08.793784 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-503ac114-6b2b-4c57-855d-f88d501c7cf3 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] [instance: 9c18953a-7af3-4d71-97ad-05eda7e34a73] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:41:08.799773 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-503ac114-6b2b-4c57-855d-f88d501c7cf3 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:41:08.800816 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-503ac114-6b2b-4c57-855d-f88d501c7cf3 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:41:08.802460 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-503ac114-6b2b-4c57-855d-f88d501c7cf3 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:41:08.802905 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-503ac114-6b2b-4c57-855d-f88d501c7cf3 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:41:09.244572 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-c31cc8c7-7d00-4571-b16c-689d3b8f73c6 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:41:09.245554 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-c31cc8c7-7d00-4571-b16c-689d3b8f73c6 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] [instance: e3dd8a17-5a2f-4f39-a110-208165e07110] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:41:09.252708 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-c31cc8c7-7d00-4571-b16c-689d3b8f73c6 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:41:09.253175 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-c31cc8c7-7d00-4571-b16c-689d3b8f73c6 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:41:09.254739 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-c31cc8c7-7d00-4571-b16c-689d3b8f73c6 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:41:09.255112 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-c31cc8c7-7d00-4571-b16c-689d3b8f73c6 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:41:09.330466 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-c31cc8c7-7d00-4571-b16c-689d3b8f73c6 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "POST /compute/v2.1/servers/e3dd8a17-5a2f-4f39-a110-208165e07110/action" status: 200 len: 6451 microversion: 2.20 time: 0.089095 Jan 21 09:41:09.331151 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 437/879] 10.222.0.45 () {62 vars in 1318 bytes} [Fri Jan 21 09:41:09 2022] POST /compute/v2.1/servers/e3dd8a17-5a2f-4f39-a110-208165e07110/action => generated 6451 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 21 09:41:09.649682 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-503ac114-6b2b-4c57-855d-f88d501c7cf3 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] 10.222.0.45 "POST /compute/v2.1/servers/9c18953a-7af3-4d71-97ad-05eda7e34a73/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.860201 Jan 21 09:41:09.651083 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 443/880] 10.222.0.45 () {60 vars in 1322 bytes} [Fri Jan 21 09:41:08 2022] POST /compute/v2.1/servers/9c18953a-7af3-4d71-97ad-05eda7e34a73/os-volume_attachments => generated 194 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 09:41:09.975331 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-dfc3231d-18e5-4174-bc56-ca3341520a05 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:41:09.975903 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-dfc3231d-18e5-4174-bc56-ca3341520a05 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] [instance: 750f8ae5-b267-4b76-bb13-170071722932] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:41:09.983562 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-dfc3231d-18e5-4174-bc56-ca3341520a05 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:41:09.984143 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-dfc3231d-18e5-4174-bc56-ca3341520a05 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:41:09.985213 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-dfc3231d-18e5-4174-bc56-ca3341520a05 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:41:09.985647 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-dfc3231d-18e5-4174-bc56-ca3341520a05 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:41:10.010241 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-dfc3231d-18e5-4174-bc56-ca3341520a05 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] [instance: 750f8ae5-b267-4b76-bb13-170071722932] Going to try to terminate instance {{(pid=123386) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 21 09:41:10.290325 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-dfc3231d-18e5-4174-bc56-ca3341520a05 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] 10.222.0.45 "DELETE /compute/v2.1/servers/750f8ae5-b267-4b76-bb13-170071722932" status: 204 len: 0 microversion: 2.1 time: 0.319343 Jan 21 09:41:10.290969 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 438/881] 10.222.0.45 () {58 vars in 1238 bytes} [Fri Jan 21 09:41:09 2022] DELETE /compute/v2.1/servers/750f8ae5-b267-4b76-bb13-170071722932 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 21 09:41:10.299779 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-d6654d1e-89ba-4f80-9e88-3cedc72b5497 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:41:10.300553 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-d6654d1e-89ba-4f80-9e88-3cedc72b5497 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] [instance: 750f8ae5-b267-4b76-bb13-170071722932] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:41:10.306938 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-d6654d1e-89ba-4f80-9e88-3cedc72b5497 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:41:10.307387 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-d6654d1e-89ba-4f80-9e88-3cedc72b5497 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:41:10.308185 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-d6654d1e-89ba-4f80-9e88-3cedc72b5497 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:41:10.308611 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-d6654d1e-89ba-4f80-9e88-3cedc72b5497 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:41:10.343200 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-e74eeb66-6437-4b2c-9ae4-2671a29cd08f tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:41:10.344225 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-e74eeb66-6437-4b2c-9ae4-2671a29cd08f tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] [instance: e3dd8a17-5a2f-4f39-a110-208165e07110] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:41:10.353260 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-e74eeb66-6437-4b2c-9ae4-2671a29cd08f tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:41:10.353831 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-e74eeb66-6437-4b2c-9ae4-2671a29cd08f tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:41:10.354732 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-e74eeb66-6437-4b2c-9ae4-2671a29cd08f tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:41:10.355235 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-e74eeb66-6437-4b2c-9ae4-2671a29cd08f tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:41:10.434183 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-e74eeb66-6437-4b2c-9ae4-2671a29cd08f tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "POST /compute/v2.1/servers/e3dd8a17-5a2f-4f39-a110-208165e07110/action" status: 200 len: 15025 microversion: 2.20 time: 0.094860 Jan 21 09:41:10.435932 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 439/882] 10.222.0.45 () {62 vars in 1318 bytes} [Fri Jan 21 09:41:10 2022] POST /compute/v2.1/servers/e3dd8a17-5a2f-4f39-a110-208165e07110/action => generated 15025 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 21 09:41:10.448623 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-d6654d1e-89ba-4f80-9e88-3cedc72b5497 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a8838f167743678110ca0a9d5a2484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10ed49573f464cc18794b94fd1c115ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:41:10.457565 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-d6654d1e-89ba-4f80-9e88-3cedc72b5497 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] 10.222.0.45 "GET /compute/v2.1/servers/750f8ae5-b267-4b76-bb13-170071722932" status: 200 len: 1553 microversion: 2.1 time: 0.161996 Jan 21 09:41:10.458152 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 444/883] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:41:10 2022] GET /compute/v2.1/servers/750f8ae5-b267-4b76-bb13-170071722932 => generated 1553 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:41:11.447318 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-efa6b0a5-798d-4e6d-9003-db97d1531960 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:41:11.448592 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-efa6b0a5-798d-4e6d-9003-db97d1531960 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] [instance: e3dd8a17-5a2f-4f39-a110-208165e07110] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:41:11.455682 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-efa6b0a5-798d-4e6d-9003-db97d1531960 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:41:11.456187 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-efa6b0a5-798d-4e6d-9003-db97d1531960 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:41:11.457169 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-efa6b0a5-798d-4e6d-9003-db97d1531960 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:41:11.457853 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-efa6b0a5-798d-4e6d-9003-db97d1531960 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:41:11.482217 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-a67efc53-0ea2-4a64-a865-ceec5ff0ed99 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:41:11.483065 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-a67efc53-0ea2-4a64-a865-ceec5ff0ed99 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] [instance: 750f8ae5-b267-4b76-bb13-170071722932] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:41:11.490758 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-a67efc53-0ea2-4a64-a865-ceec5ff0ed99 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:41:11.491197 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-a67efc53-0ea2-4a64-a865-ceec5ff0ed99 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:41:11.491984 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-a67efc53-0ea2-4a64-a865-ceec5ff0ed99 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:41:11.492419 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-a67efc53-0ea2-4a64-a865-ceec5ff0ed99 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:41:11.541974 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-efa6b0a5-798d-4e6d-9003-db97d1531960 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "POST /compute/v2.1/servers/e3dd8a17-5a2f-4f39-a110-208165e07110/action" status: 200 len: 18356 microversion: 2.20 time: 0.098272 Jan 21 09:41:11.542798 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 440/884] 10.222.0.45 () {62 vars in 1318 bytes} [Fri Jan 21 09:41:11 2022] POST /compute/v2.1/servers/e3dd8a17-5a2f-4f39-a110-208165e07110/action => generated 18356 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 21 09:41:11.636009 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-a67efc53-0ea2-4a64-a865-ceec5ff0ed99 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a8838f167743678110ca0a9d5a2484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10ed49573f464cc18794b94fd1c115ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:41:11.647479 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-a67efc53-0ea2-4a64-a865-ceec5ff0ed99 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] 10.222.0.45 "GET /compute/v2.1/servers/750f8ae5-b267-4b76-bb13-170071722932" status: 200 len: 1553 microversion: 2.1 time: 0.172684 Jan 21 09:41:11.647479 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 445/885] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:41:11 2022] GET /compute/v2.1/servers/750f8ae5-b267-4b76-bb13-170071722932 => generated 1553 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 09:41:12.554727 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-3e682988-d6c6-4329-bc68-ac57eaccf3c9 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:41:12.555962 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-3e682988-d6c6-4329-bc68-ac57eaccf3c9 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] [instance: e3dd8a17-5a2f-4f39-a110-208165e07110] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:41:12.563192 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-3e682988-d6c6-4329-bc68-ac57eaccf3c9 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:41:12.566422 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-3e682988-d6c6-4329-bc68-ac57eaccf3c9 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:41:12.566422 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-3e682988-d6c6-4329-bc68-ac57eaccf3c9 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:41:12.566422 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-3e682988-d6c6-4329-bc68-ac57eaccf3c9 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:41:12.646709 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-3e682988-d6c6-4329-bc68-ac57eaccf3c9 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "POST /compute/v2.1/servers/e3dd8a17-5a2f-4f39-a110-208165e07110/action" status: 200 len: 19342 microversion: 2.20 time: 0.097059 Jan 21 09:41:12.651696 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 441/886] 10.222.0.45 () {62 vars in 1318 bytes} [Fri Jan 21 09:41:12 2022] POST /compute/v2.1/servers/e3dd8a17-5a2f-4f39-a110-208165e07110/action => generated 19342 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 21 09:41:12.662488 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-bcf6dd03-b4eb-4f70-a84e-3eb54a70819b tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:41:12.663176 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-bcf6dd03-b4eb-4f70-a84e-3eb54a70819b tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] [instance: 750f8ae5-b267-4b76-bb13-170071722932] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:41:12.669967 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-bcf6dd03-b4eb-4f70-a84e-3eb54a70819b tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:41:12.670775 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-bcf6dd03-b4eb-4f70-a84e-3eb54a70819b tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:41:12.671746 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-bcf6dd03-b4eb-4f70-a84e-3eb54a70819b tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:41:12.672186 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-bcf6dd03-b4eb-4f70-a84e-3eb54a70819b tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:41:12.777682 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-bcf6dd03-b4eb-4f70-a84e-3eb54a70819b tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a8838f167743678110ca0a9d5a2484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10ed49573f464cc18794b94fd1c115ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:41:12.785825 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-bcf6dd03-b4eb-4f70-a84e-3eb54a70819b tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] 10.222.0.45 "GET /compute/v2.1/servers/750f8ae5-b267-4b76-bb13-170071722932" status: 200 len: 1511 microversion: 2.1 time: 0.126966 Jan 21 09:41:12.786430 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 446/887] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:41:12 2022] GET /compute/v2.1/servers/750f8ae5-b267-4b76-bb13-170071722932 => generated 1511 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:41:12.936592 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [req-4443a398-0961-4caf-915a-e9e9c975a3f3 req-2987fcaf-77f8-4905-b86d-01b4b5d3b6f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "750f8ae5-b267-4b76-bb13-170071722932", "name": "network-vif-deleted", "tag": "d22f9cde-e9ce-4b37-9b2a-f673b65a0353"}]} {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:41:12.939791 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 21 09:41:12.939791 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: warnings.warn(msg) Jan 21 09:41:12.947963 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [req-4443a398-0961-4caf-915a-e9e9c975a3f3 req-2987fcaf-77f8-4905-b86d-01b4b5d3b6f1 service nova] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:41:12.948405 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [req-4443a398-0961-4caf-915a-e9e9c975a3f3 req-2987fcaf-77f8-4905-b86d-01b4b5d3b6f1 service nova] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:41:12.960300 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.compute.server_external_events [req-4443a398-0961-4caf-915a-e9e9c975a3f3 req-2987fcaf-77f8-4905-b86d-01b4b5d3b6f1 service nova] Creating event network-vif-deleted:d22f9cde-e9ce-4b37-9b2a-f673b65a0353 for instance 750f8ae5-b267-4b76-bb13-170071722932 on hv-cinder-80403 Jan 21 09:41:12.965317 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [req-4443a398-0961-4caf-915a-e9e9c975a3f3 req-2987fcaf-77f8-4905-b86d-01b4b5d3b6f1 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.156434 Jan 21 09:41:12.969470 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 442/888] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Jan 21 09:41:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 09:41:13.658187 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-050ed389-d881-4afe-b1d2-2f94d4a07fa2 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:41:13.659272 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-050ed389-d881-4afe-b1d2-2f94d4a07fa2 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] [instance: e3dd8a17-5a2f-4f39-a110-208165e07110] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:41:13.665764 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-050ed389-d881-4afe-b1d2-2f94d4a07fa2 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:41:13.666380 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-050ed389-d881-4afe-b1d2-2f94d4a07fa2 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:41:13.666987 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-050ed389-d881-4afe-b1d2-2f94d4a07fa2 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:41:13.667432 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-050ed389-d881-4afe-b1d2-2f94d4a07fa2 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:41:13.744112 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-050ed389-d881-4afe-b1d2-2f94d4a07fa2 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "POST /compute/v2.1/servers/e3dd8a17-5a2f-4f39-a110-208165e07110/action" status: 200 len: 21935 microversion: 2.20 time: 0.089460 Jan 21 09:41:13.745016 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 447/889] 10.222.0.45 () {62 vars in 1318 bytes} [Fri Jan 21 09:41:13 2022] POST /compute/v2.1/servers/e3dd8a17-5a2f-4f39-a110-208165e07110/action => generated 21935 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 21 09:41:13.804263 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-dd04bb9b-44e3-498b-ae0f-fcef263c5a72 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:41:13.804957 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-dd04bb9b-44e3-498b-ae0f-fcef263c5a72 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] [instance: 750f8ae5-b267-4b76-bb13-170071722932] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:41:13.811128 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-dd04bb9b-44e3-498b-ae0f-fcef263c5a72 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:41:13.811578 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-dd04bb9b-44e3-498b-ae0f-fcef263c5a72 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:41:13.812364 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-dd04bb9b-44e3-498b-ae0f-fcef263c5a72 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:41:13.812800 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-dd04bb9b-44e3-498b-ae0f-fcef263c5a72 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:41:13.843867 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-dd04bb9b-44e3-498b-ae0f-fcef263c5a72 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:41:13.844302 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-dd04bb9b-44e3-498b-ae0f-fcef263c5a72 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:41:13.844747 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.objects.instance [None req-dd04bb9b-44e3-498b-ae0f-fcef263c5a72 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Lazy-loading 'fault' on Instance uuid 750f8ae5-b267-4b76-bb13-170071722932 {{(pid=123386) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 21 09:41:13.897042 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-dd04bb9b-44e3-498b-ae0f-fcef263c5a72 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '84a8838f167743678110ca0a9d5a2484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10ed49573f464cc18794b94fd1c115ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:41:13.904360 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-dd04bb9b-44e3-498b-ae0f-fcef263c5a72 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] 10.222.0.45 "GET /compute/v2.1/servers/750f8ae5-b267-4b76-bb13-170071722932" status: 200 len: 1347 microversion: 2.1 time: 0.105017 Jan 21 09:41:13.904642 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 443/890] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:41:13 2022] GET /compute/v2.1/servers/750f8ae5-b267-4b76-bb13-170071722932 => generated 1347 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 09:41:14.757046 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-deb57ee7-6673-4e13-88e0-c853017311d9 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:41:14.758175 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-deb57ee7-6673-4e13-88e0-c853017311d9 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] [instance: e3dd8a17-5a2f-4f39-a110-208165e07110] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:41:14.765254 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-deb57ee7-6673-4e13-88e0-c853017311d9 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:41:14.765797 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-deb57ee7-6673-4e13-88e0-c853017311d9 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:41:14.766821 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-deb57ee7-6673-4e13-88e0-c853017311d9 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:41:14.767268 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-deb57ee7-6673-4e13-88e0-c853017311d9 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:41:14.839157 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-deb57ee7-6673-4e13-88e0-c853017311d9 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "POST /compute/v2.1/servers/e3dd8a17-5a2f-4f39-a110-208165e07110/action" status: 200 len: 23235 microversion: 2.20 time: 0.086679 Jan 21 09:41:14.839809 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 448/891] 10.222.0.45 () {62 vars in 1318 bytes} [Fri Jan 21 09:41:14 2022] POST /compute/v2.1/servers/e3dd8a17-5a2f-4f39-a110-208165e07110/action => generated 23235 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 21 09:41:14.920709 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-26ea7fa9-1eec-429e-83c5-4c300c843bc1 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:41:14.921425 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-26ea7fa9-1eec-429e-83c5-4c300c843bc1 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] [instance: 750f8ae5-b267-4b76-bb13-170071722932] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:41:14.929894 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-26ea7fa9-1eec-429e-83c5-4c300c843bc1 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:41:14.930454 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-26ea7fa9-1eec-429e-83c5-4c300c843bc1 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:41:14.931322 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-26ea7fa9-1eec-429e-83c5-4c300c843bc1 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:41:14.931901 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-26ea7fa9-1eec-429e-83c5-4c300c843bc1 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:41:14.947237 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.wsgi [None req-26ea7fa9-1eec-429e-83c5-4c300c843bc1 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] HTTP exception thrown: Instance 750f8ae5-b267-4b76-bb13-170071722932 could not be found. Jan 21 09:41:14.947935 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-26ea7fa9-1eec-429e-83c5-4c300c843bc1 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Returning 404 to user: Instance 750f8ae5-b267-4b76-bb13-170071722932 could not be found. {{(pid=123386) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 21 09:41:14.948992 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-26ea7fa9-1eec-429e-83c5-4c300c843bc1 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] 10.222.0.45 "GET /compute/v2.1/servers/750f8ae5-b267-4b76-bb13-170071722932" status: 404 len: 111 microversion: 2.1 time: 0.031806 Jan 21 09:41:14.949857 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 444/892] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:41:14 2022] GET /compute/v2.1/servers/750f8ae5-b267-4b76-bb13-170071722932 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 21 09:41:14.959565 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-6b46bb97-26ea-456f-b4bd-02d0aa78e683 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] Calling method '.version_select at 0x7fb6c2a88790>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:41:15.056549 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-6b46bb97-26ea-456f-b4bd-02d0aa78e683 tempest-TestMinimumBasicScenario-560934513 tempest-TestMinimumBasicScenario-560934513-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-226234256" status: 202 len: 0 microversion: 2.1 time: 0.102260 Jan 21 09:41:15.057658 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 449/893] 10.222.0.45 () {58 vars in 1268 bytes} [Fri Jan 21 09:41:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-226234256 => generated 0 bytes in 104 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 21 09:41:15.850584 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-cdbb86f3-0427-4da7-a978-ad746eae9c1b tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:41:15.851504 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-cdbb86f3-0427-4da7-a978-ad746eae9c1b tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] [instance: e3dd8a17-5a2f-4f39-a110-208165e07110] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:41:15.858077 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-cdbb86f3-0427-4da7-a978-ad746eae9c1b tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:41:15.858657 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-cdbb86f3-0427-4da7-a978-ad746eae9c1b tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:41:15.859346 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-cdbb86f3-0427-4da7-a978-ad746eae9c1b tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:41:15.860045 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-cdbb86f3-0427-4da7-a978-ad746eae9c1b tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:41:15.939093 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-cdbb86f3-0427-4da7-a978-ad746eae9c1b tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "POST /compute/v2.1/servers/e3dd8a17-5a2f-4f39-a110-208165e07110/action" status: 200 len: 24897 microversion: 2.20 time: 0.092147 Jan 21 09:41:15.940085 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 445/894] 10.222.0.45 () {62 vars in 1318 bytes} [Fri Jan 21 09:41:15 2022] POST /compute/v2.1/servers/e3dd8a17-5a2f-4f39-a110-208165e07110/action => generated 24897 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 21 09:41:16.951848 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-f5049552-9f81-4744-b632-d450176d7c4a tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:41:16.952983 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-f5049552-9f81-4744-b632-d450176d7c4a tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] [instance: e3dd8a17-5a2f-4f39-a110-208165e07110] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:41:16.960104 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-f5049552-9f81-4744-b632-d450176d7c4a tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:41:16.960614 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-f5049552-9f81-4744-b632-d450176d7c4a tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:41:16.961612 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-f5049552-9f81-4744-b632-d450176d7c4a tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:41:16.962127 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-f5049552-9f81-4744-b632-d450176d7c4a tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:41:17.040166 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-f5049552-9f81-4744-b632-d450176d7c4a tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "POST /compute/v2.1/servers/e3dd8a17-5a2f-4f39-a110-208165e07110/action" status: 200 len: 26466 microversion: 2.20 time: 0.092259 Jan 21 09:41:17.042416 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 450/895] 10.222.0.45 () {62 vars in 1318 bytes} [Fri Jan 21 09:41:16 2022] POST /compute/v2.1/servers/e3dd8a17-5a2f-4f39-a110-208165e07110/action => generated 26466 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 21 09:41:17.162653 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-318799ca-278e-447f-b17d-8dfef09e20d1 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:41:17.172715 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-318799ca-278e-447f-b17d-8dfef09e20d1 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:41:17.172715 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-318799ca-278e-447f-b17d-8dfef09e20d1 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:41:17.241128 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-318799ca-278e-447f-b17d-8dfef09e20d1 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] [instance: 9c18953a-7af3-4d71-97ad-05eda7e34a73] Going to try to stop instance {{(pid=123386) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Jan 21 09:41:17.477724 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-318799ca-278e-447f-b17d-8dfef09e20d1 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] 10.222.0.45 "POST /compute/v2.1/servers/9c18953a-7af3-4d71-97ad-05eda7e34a73/action" status: 202 len: 0 microversion: 2.1 time: 0.319031 Jan 21 09:41:17.478249 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 446/896] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Jan 21 09:41:17 2022] POST /compute/v2.1/servers/9c18953a-7af3-4d71-97ad-05eda7e34a73/action => generated 0 bytes in 321 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 21 09:41:17.488055 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-27bb8a32-036e-460b-b728-1452d1a98f21 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:41:17.488792 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-27bb8a32-036e-460b-b728-1452d1a98f21 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] [instance: 9c18953a-7af3-4d71-97ad-05eda7e34a73] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:41:17.495872 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-27bb8a32-036e-460b-b728-1452d1a98f21 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:41:17.496321 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-27bb8a32-036e-460b-b728-1452d1a98f21 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:41:17.497125 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-27bb8a32-036e-460b-b728-1452d1a98f21 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:41:17.497591 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-27bb8a32-036e-460b-b728-1452d1a98f21 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:41:17.725867 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-27bb8a32-036e-460b-b728-1452d1a98f21 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '590e721135c84df5946147ac7e944fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2322cb784615409bb15a6f49522d3b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:41:17.734430 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-27bb8a32-036e-460b-b728-1452d1a98f21 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] 10.222.0.45 "GET /compute/v2.1/servers/9c18953a-7af3-4d71-97ad-05eda7e34a73" status: 200 len: 1726 microversion: 2.1 time: 0.251559 Jan 21 09:41:17.735312 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 451/897] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:41:17 2022] GET /compute/v2.1/servers/9c18953a-7af3-4d71-97ad-05eda7e34a73 => generated 1726 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:41:18.055302 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-18cf5afe-6bd7-4784-bffb-06c04cbdf272 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:41:18.056444 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-18cf5afe-6bd7-4784-bffb-06c04cbdf272 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] [instance: e3dd8a17-5a2f-4f39-a110-208165e07110] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:41:18.063767 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-18cf5afe-6bd7-4784-bffb-06c04cbdf272 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:41:18.064217 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-18cf5afe-6bd7-4784-bffb-06c04cbdf272 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:41:18.065051 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-18cf5afe-6bd7-4784-bffb-06c04cbdf272 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:41:18.065625 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-18cf5afe-6bd7-4784-bffb-06c04cbdf272 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:41:18.152593 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-18cf5afe-6bd7-4784-bffb-06c04cbdf272 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "POST /compute/v2.1/servers/e3dd8a17-5a2f-4f39-a110-208165e07110/action" status: 200 len: 27580 microversion: 2.20 time: 0.102571 Jan 21 09:41:18.156722 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 447/898] 10.222.0.45 () {62 vars in 1318 bytes} [Fri Jan 21 09:41:18 2022] POST /compute/v2.1/servers/e3dd8a17-5a2f-4f39-a110-208165e07110/action => generated 27580 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 21 09:41:18.754183 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-7dd25a20-d04b-44a0-bd84-f27a5b3c0fd4 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:41:18.755451 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-7dd25a20-d04b-44a0-bd84-f27a5b3c0fd4 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] [instance: 9c18953a-7af3-4d71-97ad-05eda7e34a73] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:41:18.764396 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-7dd25a20-d04b-44a0-bd84-f27a5b3c0fd4 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:41:18.764860 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-7dd25a20-d04b-44a0-bd84-f27a5b3c0fd4 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:41:18.766190 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-7dd25a20-d04b-44a0-bd84-f27a5b3c0fd4 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:41:18.766642 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-7dd25a20-d04b-44a0-bd84-f27a5b3c0fd4 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:41:19.046234 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-7dd25a20-d04b-44a0-bd84-f27a5b3c0fd4 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '590e721135c84df5946147ac7e944fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2322cb784615409bb15a6f49522d3b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:41:19.057998 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-7dd25a20-d04b-44a0-bd84-f27a5b3c0fd4 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] 10.222.0.45 "GET /compute/v2.1/servers/9c18953a-7af3-4d71-97ad-05eda7e34a73" status: 200 len: 1726 microversion: 2.1 time: 0.307602 Jan 21 09:41:19.058694 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 452/899] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:41:18 2022] GET /compute/v2.1/servers/9c18953a-7af3-4d71-97ad-05eda7e34a73 => generated 1726 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:41:19.164896 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-faafe3af-f5f7-460b-ae87-06ae7c64b808 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:41:19.166065 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-faafe3af-f5f7-460b-ae87-06ae7c64b808 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] [instance: e3dd8a17-5a2f-4f39-a110-208165e07110] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:41:19.172681 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-faafe3af-f5f7-460b-ae87-06ae7c64b808 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:41:19.173186 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-faafe3af-f5f7-460b-ae87-06ae7c64b808 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:41:19.173948 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-faafe3af-f5f7-460b-ae87-06ae7c64b808 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:41:19.174374 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-faafe3af-f5f7-460b-ae87-06ae7c64b808 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:41:19.263730 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-faafe3af-f5f7-460b-ae87-06ae7c64b808 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "POST /compute/v2.1/servers/e3dd8a17-5a2f-4f39-a110-208165e07110/action" status: 200 len: 28045 microversion: 2.20 time: 0.103450 Jan 21 09:41:19.265090 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 448/900] 10.222.0.45 () {62 vars in 1318 bytes} [Fri Jan 21 09:41:19 2022] POST /compute/v2.1/servers/e3dd8a17-5a2f-4f39-a110-208165e07110/action => generated 28045 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 21 09:41:20.077050 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-a300f4ce-1f9a-4933-a4cc-ce63019005fa tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:41:20.085207 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-a300f4ce-1f9a-4933-a4cc-ce63019005fa tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] [instance: 9c18953a-7af3-4d71-97ad-05eda7e34a73] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:41:20.085912 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-a300f4ce-1f9a-4933-a4cc-ce63019005fa tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:41:20.087160 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-a300f4ce-1f9a-4933-a4cc-ce63019005fa tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:41:20.087877 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-a300f4ce-1f9a-4933-a4cc-ce63019005fa tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:41:20.088317 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-a300f4ce-1f9a-4933-a4cc-ce63019005fa tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:41:20.283099 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-e58ee76e-b1ea-4030-a73a-b9fd1506fb0c tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:41:20.291442 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-e58ee76e-b1ea-4030-a73a-b9fd1506fb0c tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] [instance: e3dd8a17-5a2f-4f39-a110-208165e07110] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:41:20.306341 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-e58ee76e-b1ea-4030-a73a-b9fd1506fb0c tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:41:20.307420 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-e58ee76e-b1ea-4030-a73a-b9fd1506fb0c tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:41:20.309646 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-e58ee76e-b1ea-4030-a73a-b9fd1506fb0c tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:41:20.310831 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-e58ee76e-b1ea-4030-a73a-b9fd1506fb0c tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:41:20.385044 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-a300f4ce-1f9a-4933-a4cc-ce63019005fa tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '590e721135c84df5946147ac7e944fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2322cb784615409bb15a6f49522d3b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:41:20.398487 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-a300f4ce-1f9a-4933-a4cc-ce63019005fa tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] 10.222.0.45 "GET /compute/v2.1/servers/9c18953a-7af3-4d71-97ad-05eda7e34a73" status: 200 len: 1726 microversion: 2.1 time: 0.325224 Jan 21 09:41:20.399555 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 453/901] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:41:20 2022] GET /compute/v2.1/servers/9c18953a-7af3-4d71-97ad-05eda7e34a73 => generated 1726 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:41:20.438780 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-e58ee76e-b1ea-4030-a73a-b9fd1506fb0c tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "POST /compute/v2.1/servers/e3dd8a17-5a2f-4f39-a110-208165e07110/action" status: 200 len: 28249 microversion: 2.20 time: 0.163182 Jan 21 09:41:20.439436 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 449/902] 10.222.0.45 () {62 vars in 1318 bytes} [Fri Jan 21 09:41:20 2022] POST /compute/v2.1/servers/e3dd8a17-5a2f-4f39-a110-208165e07110/action => generated 28249 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 21 09:41:21.423758 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-4cc5291f-337b-44db-9d32-76cdabc2be27 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:41:21.424810 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-4cc5291f-337b-44db-9d32-76cdabc2be27 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] [instance: 9c18953a-7af3-4d71-97ad-05eda7e34a73] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:41:21.433187 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-4cc5291f-337b-44db-9d32-76cdabc2be27 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:41:21.433908 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-4cc5291f-337b-44db-9d32-76cdabc2be27 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:41:21.434932 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-4cc5291f-337b-44db-9d32-76cdabc2be27 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:41:21.435579 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-4cc5291f-337b-44db-9d32-76cdabc2be27 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:41:21.454622 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-f2082095-914b-41dd-9d68-1e4f38209882 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:41:21.456969 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-f2082095-914b-41dd-9d68-1e4f38209882 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] [instance: e3dd8a17-5a2f-4f39-a110-208165e07110] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:41:21.466043 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-f2082095-914b-41dd-9d68-1e4f38209882 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:41:21.466642 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-f2082095-914b-41dd-9d68-1e4f38209882 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:41:21.468018 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-f2082095-914b-41dd-9d68-1e4f38209882 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:41:21.468780 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-f2082095-914b-41dd-9d68-1e4f38209882 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:41:21.556664 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-f2082095-914b-41dd-9d68-1e4f38209882 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "POST /compute/v2.1/servers/e3dd8a17-5a2f-4f39-a110-208165e07110/action" status: 200 len: 28249 microversion: 2.20 time: 0.107504 Jan 21 09:41:21.557944 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 450/903] 10.222.0.45 () {62 vars in 1318 bytes} [Fri Jan 21 09:41:21 2022] POST /compute/v2.1/servers/e3dd8a17-5a2f-4f39-a110-208165e07110/action => generated 28249 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 21 09:41:21.735172 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-4cc5291f-337b-44db-9d32-76cdabc2be27 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '590e721135c84df5946147ac7e944fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2322cb784615409bb15a6f49522d3b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:41:21.750128 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-4cc5291f-337b-44db-9d32-76cdabc2be27 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] 10.222.0.45 "GET /compute/v2.1/servers/9c18953a-7af3-4d71-97ad-05eda7e34a73" status: 200 len: 1726 microversion: 2.1 time: 0.330367 Jan 21 09:41:21.759027 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 454/904] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:41:21 2022] GET /compute/v2.1/servers/9c18953a-7af3-4d71-97ad-05eda7e34a73 => generated 1726 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:41:22.578590 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-777d803e-49ef-4142-a70e-761ad2afc134 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:41:22.580500 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-777d803e-49ef-4142-a70e-761ad2afc134 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] [instance: e3dd8a17-5a2f-4f39-a110-208165e07110] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:41:22.593555 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-777d803e-49ef-4142-a70e-761ad2afc134 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:41:22.594495 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-777d803e-49ef-4142-a70e-761ad2afc134 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:41:22.596022 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-777d803e-49ef-4142-a70e-761ad2afc134 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:41:22.598130 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-777d803e-49ef-4142-a70e-761ad2afc134 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:41:22.714841 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-777d803e-49ef-4142-a70e-761ad2afc134 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "POST /compute/v2.1/servers/e3dd8a17-5a2f-4f39-a110-208165e07110/action" status: 200 len: 28540 microversion: 2.20 time: 0.143857 Jan 21 09:41:22.717697 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 451/905] 10.222.0.45 () {62 vars in 1318 bytes} [Fri Jan 21 09:41:22 2022] POST /compute/v2.1/servers/e3dd8a17-5a2f-4f39-a110-208165e07110/action => generated 28540 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 21 09:41:22.786222 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-058a03c7-c8ec-4d8a-a17c-1939e31e8e18 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:41:22.787350 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-058a03c7-c8ec-4d8a-a17c-1939e31e8e18 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] [instance: 9c18953a-7af3-4d71-97ad-05eda7e34a73] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:41:22.795844 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-058a03c7-c8ec-4d8a-a17c-1939e31e8e18 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:41:22.796435 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-058a03c7-c8ec-4d8a-a17c-1939e31e8e18 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:41:22.797436 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-058a03c7-c8ec-4d8a-a17c-1939e31e8e18 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:41:22.798198 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-058a03c7-c8ec-4d8a-a17c-1939e31e8e18 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:41:23.140879 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-058a03c7-c8ec-4d8a-a17c-1939e31e8e18 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '590e721135c84df5946147ac7e944fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2322cb784615409bb15a6f49522d3b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:41:23.159446 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-058a03c7-c8ec-4d8a-a17c-1939e31e8e18 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] 10.222.0.45 "GET /compute/v2.1/servers/9c18953a-7af3-4d71-97ad-05eda7e34a73" status: 200 len: 1726 microversion: 2.1 time: 0.383190 Jan 21 09:41:23.166992 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 455/906] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:41:22 2022] GET /compute/v2.1/servers/9c18953a-7af3-4d71-97ad-05eda7e34a73 => generated 1726 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 09:41:23.733366 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-7d596f7e-34bc-43b0-bcf5-721bbc676382 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:41:23.735308 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-7d596f7e-34bc-43b0-bcf5-721bbc676382 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] [instance: e3dd8a17-5a2f-4f39-a110-208165e07110] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:41:23.745244 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-7d596f7e-34bc-43b0-bcf5-721bbc676382 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:41:23.745515 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-7d596f7e-34bc-43b0-bcf5-721bbc676382 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:41:23.746334 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-7d596f7e-34bc-43b0-bcf5-721bbc676382 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:41:23.746802 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-7d596f7e-34bc-43b0-bcf5-721bbc676382 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:41:23.829476 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-7d596f7e-34bc-43b0-bcf5-721bbc676382 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "POST /compute/v2.1/servers/e3dd8a17-5a2f-4f39-a110-208165e07110/action" status: 200 len: 28708 microversion: 2.20 time: 0.102179 Jan 21 09:41:23.830133 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 452/907] 10.222.0.45 () {62 vars in 1318 bytes} [Fri Jan 21 09:41:23 2022] POST /compute/v2.1/servers/e3dd8a17-5a2f-4f39-a110-208165e07110/action => generated 28708 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 21 09:41:24.191820 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-0da6c596-8111-462b-92e0-0aa7c889fc2e tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:41:24.193372 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-0da6c596-8111-462b-92e0-0aa7c889fc2e tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] [instance: 9c18953a-7af3-4d71-97ad-05eda7e34a73] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:41:24.200989 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-0da6c596-8111-462b-92e0-0aa7c889fc2e tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:41:24.201769 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-0da6c596-8111-462b-92e0-0aa7c889fc2e tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:41:24.202775 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-0da6c596-8111-462b-92e0-0aa7c889fc2e tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:41:24.203462 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-0da6c596-8111-462b-92e0-0aa7c889fc2e tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:41:24.461654 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-0da6c596-8111-462b-92e0-0aa7c889fc2e tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '590e721135c84df5946147ac7e944fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2322cb784615409bb15a6f49522d3b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:41:24.472323 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-0da6c596-8111-462b-92e0-0aa7c889fc2e tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] 10.222.0.45 "GET /compute/v2.1/servers/9c18953a-7af3-4d71-97ad-05eda7e34a73" status: 200 len: 1726 microversion: 2.1 time: 0.284680 Jan 21 09:41:24.473281 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 456/908] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:41:24 2022] GET /compute/v2.1/servers/9c18953a-7af3-4d71-97ad-05eda7e34a73 => generated 1726 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:41:24.842575 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-0f02b8d3-b30f-4011-8cc8-aa441f0f9d9c tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:41:24.843444 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-0f02b8d3-b30f-4011-8cc8-aa441f0f9d9c tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] [instance: e3dd8a17-5a2f-4f39-a110-208165e07110] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:41:24.851038 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-0f02b8d3-b30f-4011-8cc8-aa441f0f9d9c tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:41:24.851493 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-0f02b8d3-b30f-4011-8cc8-aa441f0f9d9c tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:41:24.852280 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-0f02b8d3-b30f-4011-8cc8-aa441f0f9d9c tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:41:24.852715 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-0f02b8d3-b30f-4011-8cc8-aa441f0f9d9c tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:41:24.916001 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-0f02b8d3-b30f-4011-8cc8-aa441f0f9d9c tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "POST /compute/v2.1/servers/e3dd8a17-5a2f-4f39-a110-208165e07110/action" status: 200 len: 28708 microversion: 2.20 time: 0.077449 Jan 21 09:41:24.916906 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 453/909] 10.222.0.45 () {62 vars in 1318 bytes} [Fri Jan 21 09:41:24 2022] POST /compute/v2.1/servers/e3dd8a17-5a2f-4f39-a110-208165e07110/action => generated 28708 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 21 09:41:25.495868 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-9f366225-6c3f-4d4c-95d2-41be4c6b74df tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:41:25.496583 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-9f366225-6c3f-4d4c-95d2-41be4c6b74df tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] [instance: 9c18953a-7af3-4d71-97ad-05eda7e34a73] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:41:25.505098 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-9f366225-6c3f-4d4c-95d2-41be4c6b74df tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:41:25.505846 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-9f366225-6c3f-4d4c-95d2-41be4c6b74df tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:41:25.507121 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-9f366225-6c3f-4d4c-95d2-41be4c6b74df tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:41:25.507727 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-9f366225-6c3f-4d4c-95d2-41be4c6b74df tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:41:25.869125 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-9f366225-6c3f-4d4c-95d2-41be4c6b74df tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '590e721135c84df5946147ac7e944fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2322cb784615409bb15a6f49522d3b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:41:25.884797 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-9f366225-6c3f-4d4c-95d2-41be4c6b74df tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] 10.222.0.45 "GET /compute/v2.1/servers/9c18953a-7af3-4d71-97ad-05eda7e34a73" status: 200 len: 1726 microversion: 2.1 time: 0.398009 Jan 21 09:41:25.886016 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 457/910] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:41:25 2022] GET /compute/v2.1/servers/9c18953a-7af3-4d71-97ad-05eda7e34a73 => generated 1726 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:41:25.932395 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-46f4f83b-1838-404d-aea2-336078d6857b tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:41:25.933709 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-46f4f83b-1838-404d-aea2-336078d6857b tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] [instance: e3dd8a17-5a2f-4f39-a110-208165e07110] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:41:25.943778 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-46f4f83b-1838-404d-aea2-336078d6857b tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:41:25.949630 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-46f4f83b-1838-404d-aea2-336078d6857b tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:41:25.949630 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-46f4f83b-1838-404d-aea2-336078d6857b tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:41:25.953478 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-46f4f83b-1838-404d-aea2-336078d6857b tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:41:26.033506 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-46f4f83b-1838-404d-aea2-336078d6857b tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "POST /compute/v2.1/servers/e3dd8a17-5a2f-4f39-a110-208165e07110/action" status: 200 len: 28708 microversion: 2.20 time: 0.105059 Jan 21 09:41:26.035631 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 454/911] 10.222.0.45 () {62 vars in 1318 bytes} [Fri Jan 21 09:41:25 2022] POST /compute/v2.1/servers/e3dd8a17-5a2f-4f39-a110-208165e07110/action => generated 28708 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 21 09:41:26.908607 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-9aa2e0cb-d9a0-4a86-b9f4-4db1b39089f4 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:41:26.915541 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-9aa2e0cb-d9a0-4a86-b9f4-4db1b39089f4 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] [instance: 9c18953a-7af3-4d71-97ad-05eda7e34a73] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:41:26.931915 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-9aa2e0cb-d9a0-4a86-b9f4-4db1b39089f4 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:41:26.933693 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-9aa2e0cb-d9a0-4a86-b9f4-4db1b39089f4 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:41:26.938035 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-9aa2e0cb-d9a0-4a86-b9f4-4db1b39089f4 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:41:26.938948 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-9aa2e0cb-d9a0-4a86-b9f4-4db1b39089f4 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:41:27.054475 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-faf61440-7b43-4aa9-8aab-0665a9884630 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:41:27.059508 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-faf61440-7b43-4aa9-8aab-0665a9884630 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] [instance: e3dd8a17-5a2f-4f39-a110-208165e07110] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:41:27.074730 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-faf61440-7b43-4aa9-8aab-0665a9884630 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:41:27.075564 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-faf61440-7b43-4aa9-8aab-0665a9884630 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:41:27.077091 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-faf61440-7b43-4aa9-8aab-0665a9884630 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:41:27.078078 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-faf61440-7b43-4aa9-8aab-0665a9884630 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:41:27.199221 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-faf61440-7b43-4aa9-8aab-0665a9884630 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "POST /compute/v2.1/servers/e3dd8a17-5a2f-4f39-a110-208165e07110/action" status: 200 len: 29842 microversion: 2.20 time: 0.154682 Jan 21 09:41:27.200622 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 455/912] 10.222.0.45 () {62 vars in 1318 bytes} [Fri Jan 21 09:41:27 2022] POST /compute/v2.1/servers/e3dd8a17-5a2f-4f39-a110-208165e07110/action => generated 29842 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 21 09:41:27.238391 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-9aa2e0cb-d9a0-4a86-b9f4-4db1b39089f4 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '590e721135c84df5946147ac7e944fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2322cb784615409bb15a6f49522d3b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:41:27.249005 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-9aa2e0cb-d9a0-4a86-b9f4-4db1b39089f4 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] 10.222.0.45 "GET /compute/v2.1/servers/9c18953a-7af3-4d71-97ad-05eda7e34a73" status: 200 len: 1726 microversion: 2.1 time: 0.347985 Jan 21 09:41:27.249948 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 458/913] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:41:26 2022] GET /compute/v2.1/servers/9c18953a-7af3-4d71-97ad-05eda7e34a73 => generated 1726 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:41:28.213740 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-83dddea1-cddf-4d25-bfa3-b85cc87df800 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:41:28.215613 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-83dddea1-cddf-4d25-bfa3-b85cc87df800 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] [instance: e3dd8a17-5a2f-4f39-a110-208165e07110] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:41:28.232122 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-83dddea1-cddf-4d25-bfa3-b85cc87df800 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:41:28.232569 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-83dddea1-cddf-4d25-bfa3-b85cc87df800 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:41:28.234141 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-83dddea1-cddf-4d25-bfa3-b85cc87df800 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:41:28.244477 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-83dddea1-cddf-4d25-bfa3-b85cc87df800 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:41:28.272475 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-fc182986-baea-4421-81a8-6a01e39ce871 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:41:28.277906 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-fc182986-baea-4421-81a8-6a01e39ce871 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] [instance: 9c18953a-7af3-4d71-97ad-05eda7e34a73] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:41:28.299370 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-fc182986-baea-4421-81a8-6a01e39ce871 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:41:28.302718 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-fc182986-baea-4421-81a8-6a01e39ce871 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:41:28.302718 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-fc182986-baea-4421-81a8-6a01e39ce871 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:41:28.302718 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-fc182986-baea-4421-81a8-6a01e39ce871 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:41:28.385163 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-83dddea1-cddf-4d25-bfa3-b85cc87df800 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "POST /compute/v2.1/servers/e3dd8a17-5a2f-4f39-a110-208165e07110/action" status: 200 len: 31882 microversion: 2.20 time: 0.174918 Jan 21 09:41:28.389277 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 456/914] 10.222.0.45 () {62 vars in 1318 bytes} [Fri Jan 21 09:41:28 2022] POST /compute/v2.1/servers/e3dd8a17-5a2f-4f39-a110-208165e07110/action => generated 31882 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 21 09:41:28.621864 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-fc182986-baea-4421-81a8-6a01e39ce871 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '590e721135c84df5946147ac7e944fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2322cb784615409bb15a6f49522d3b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:41:28.632121 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-fc182986-baea-4421-81a8-6a01e39ce871 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] 10.222.0.45 "GET /compute/v2.1/servers/9c18953a-7af3-4d71-97ad-05eda7e34a73" status: 200 len: 1726 microversion: 2.1 time: 0.368209 Jan 21 09:41:28.655230 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 459/915] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:41:28 2022] GET /compute/v2.1/servers/9c18953a-7af3-4d71-97ad-05eda7e34a73 => generated 1726 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 09:41:29.402226 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-958f93e4-9021-4612-bf8d-fa39138ed900 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:41:29.403465 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-958f93e4-9021-4612-bf8d-fa39138ed900 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] [instance: e3dd8a17-5a2f-4f39-a110-208165e07110] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:41:29.412107 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-958f93e4-9021-4612-bf8d-fa39138ed900 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:41:29.419550 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-958f93e4-9021-4612-bf8d-fa39138ed900 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:41:29.419550 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-958f93e4-9021-4612-bf8d-fa39138ed900 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:41:29.419550 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-958f93e4-9021-4612-bf8d-fa39138ed900 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:41:29.497575 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-958f93e4-9021-4612-bf8d-fa39138ed900 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "POST /compute/v2.1/servers/e3dd8a17-5a2f-4f39-a110-208165e07110/action" status: 200 len: 33439 microversion: 2.20 time: 0.097672 Jan 21 09:41:29.499600 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 457/916] 10.222.0.45 () {62 vars in 1318 bytes} [Fri Jan 21 09:41:29 2022] POST /compute/v2.1/servers/e3dd8a17-5a2f-4f39-a110-208165e07110/action => generated 33439 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 21 09:41:29.666412 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-2b612996-5207-436f-bcef-e62ee7751b2e tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:41:29.671292 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-2b612996-5207-436f-bcef-e62ee7751b2e tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] [instance: 9c18953a-7af3-4d71-97ad-05eda7e34a73] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:41:29.696599 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-2b612996-5207-436f-bcef-e62ee7751b2e tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:41:29.699629 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-2b612996-5207-436f-bcef-e62ee7751b2e tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:41:29.707828 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-2b612996-5207-436f-bcef-e62ee7751b2e tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:41:29.709581 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-2b612996-5207-436f-bcef-e62ee7751b2e tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:41:30.041779 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-2b612996-5207-436f-bcef-e62ee7751b2e tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '590e721135c84df5946147ac7e944fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2322cb784615409bb15a6f49522d3b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:41:30.100782 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-2b612996-5207-436f-bcef-e62ee7751b2e tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] 10.222.0.45 "GET /compute/v2.1/servers/9c18953a-7af3-4d71-97ad-05eda7e34a73" status: 200 len: 1726 microversion: 2.1 time: 0.445297 Jan 21 09:41:30.105193 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 460/917] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:41:29 2022] GET /compute/v2.1/servers/9c18953a-7af3-4d71-97ad-05eda7e34a73 => generated 1726 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:41:30.511458 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-e099e52b-23ed-4991-878a-88dca0bcee2e tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:41:30.512498 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-e099e52b-23ed-4991-878a-88dca0bcee2e tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] [instance: e3dd8a17-5a2f-4f39-a110-208165e07110] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:41:30.520777 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-e099e52b-23ed-4991-878a-88dca0bcee2e tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:41:30.521280 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-e099e52b-23ed-4991-878a-88dca0bcee2e tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:41:30.522109 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-e099e52b-23ed-4991-878a-88dca0bcee2e tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:41:30.522546 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-e099e52b-23ed-4991-878a-88dca0bcee2e tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:41:30.608222 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-e099e52b-23ed-4991-878a-88dca0bcee2e tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "POST /compute/v2.1/servers/e3dd8a17-5a2f-4f39-a110-208165e07110/action" status: 200 len: 34517 microversion: 2.20 time: 0.100207 Jan 21 09:41:30.610247 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 458/918] 10.222.0.45 () {62 vars in 1318 bytes} [Fri Jan 21 09:41:30 2022] POST /compute/v2.1/servers/e3dd8a17-5a2f-4f39-a110-208165e07110/action => generated 34517 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 21 09:41:31.121350 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-65fddfd1-958f-48c2-abc0-6e0856bf1d41 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:41:31.123224 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-65fddfd1-958f-48c2-abc0-6e0856bf1d41 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] [instance: 9c18953a-7af3-4d71-97ad-05eda7e34a73] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:41:31.133394 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-65fddfd1-958f-48c2-abc0-6e0856bf1d41 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:41:31.134041 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-65fddfd1-958f-48c2-abc0-6e0856bf1d41 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:41:31.135124 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-65fddfd1-958f-48c2-abc0-6e0856bf1d41 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:41:31.135701 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-65fddfd1-958f-48c2-abc0-6e0856bf1d41 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:41:31.624614 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-b413ea97-03c1-4834-9b5b-c6acd1017ee6 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:41:31.626091 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-b413ea97-03c1-4834-9b5b-c6acd1017ee6 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] [instance: e3dd8a17-5a2f-4f39-a110-208165e07110] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:41:31.635954 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-b413ea97-03c1-4834-9b5b-c6acd1017ee6 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:41:31.636676 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-b413ea97-03c1-4834-9b5b-c6acd1017ee6 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:41:31.637762 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-b413ea97-03c1-4834-9b5b-c6acd1017ee6 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:41:31.638383 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-b413ea97-03c1-4834-9b5b-c6acd1017ee6 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:41:31.740956 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-b413ea97-03c1-4834-9b5b-c6acd1017ee6 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "POST /compute/v2.1/servers/e3dd8a17-5a2f-4f39-a110-208165e07110/action" status: 200 len: 35750 microversion: 2.20 time: 0.120300 Jan 21 09:41:31.742365 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 459/919] 10.222.0.45 () {62 vars in 1318 bytes} [Fri Jan 21 09:41:31 2022] POST /compute/v2.1/servers/e3dd8a17-5a2f-4f39-a110-208165e07110/action => generated 35750 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 21 09:41:31.891370 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-65fddfd1-958f-48c2-abc0-6e0856bf1d41 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '590e721135c84df5946147ac7e944fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2322cb784615409bb15a6f49522d3b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:41:31.905592 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-65fddfd1-958f-48c2-abc0-6e0856bf1d41 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] 10.222.0.45 "GET /compute/v2.1/servers/9c18953a-7af3-4d71-97ad-05eda7e34a73" status: 200 len: 1726 microversion: 2.1 time: 0.788841 Jan 21 09:41:31.906557 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 461/920] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:41:31 2022] GET /compute/v2.1/servers/9c18953a-7af3-4d71-97ad-05eda7e34a73 => generated 1726 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:41:32.755702 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-483d35cf-3363-4428-b50f-b659aa4bfd57 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:41:32.756790 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-483d35cf-3363-4428-b50f-b659aa4bfd57 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] [instance: e3dd8a17-5a2f-4f39-a110-208165e07110] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:41:32.767118 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-483d35cf-3363-4428-b50f-b659aa4bfd57 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:41:32.767859 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-483d35cf-3363-4428-b50f-b659aa4bfd57 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:41:32.770047 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-483d35cf-3363-4428-b50f-b659aa4bfd57 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:41:32.770808 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-483d35cf-3363-4428-b50f-b659aa4bfd57 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:41:32.876689 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-483d35cf-3363-4428-b50f-b659aa4bfd57 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "POST /compute/v2.1/servers/e3dd8a17-5a2f-4f39-a110-208165e07110/action" status: 200 len: 37467 microversion: 2.20 time: 0.125995 Jan 21 09:41:32.879893 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 460/921] 10.222.0.45 () {62 vars in 1318 bytes} [Fri Jan 21 09:41:32 2022] POST /compute/v2.1/servers/e3dd8a17-5a2f-4f39-a110-208165e07110/action => generated 37467 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 21 09:41:32.928409 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-6a03edfe-fda7-49c4-9552-5e7a013431e6 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:41:32.929414 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-6a03edfe-fda7-49c4-9552-5e7a013431e6 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] [instance: 9c18953a-7af3-4d71-97ad-05eda7e34a73] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:41:32.936608 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-6a03edfe-fda7-49c4-9552-5e7a013431e6 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:41:32.939800 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-6a03edfe-fda7-49c4-9552-5e7a013431e6 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:41:32.939800 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-6a03edfe-fda7-49c4-9552-5e7a013431e6 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:41:32.939800 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-6a03edfe-fda7-49c4-9552-5e7a013431e6 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:41:33.148578 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-6a03edfe-fda7-49c4-9552-5e7a013431e6 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '590e721135c84df5946147ac7e944fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2322cb784615409bb15a6f49522d3b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:41:33.169055 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-6a03edfe-fda7-49c4-9552-5e7a013431e6 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] 10.222.0.45 "GET /compute/v2.1/servers/9c18953a-7af3-4d71-97ad-05eda7e34a73" status: 200 len: 1726 microversion: 2.1 time: 0.240584 Jan 21 09:41:33.170406 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 462/922] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:41:32 2022] GET /compute/v2.1/servers/9c18953a-7af3-4d71-97ad-05eda7e34a73 => generated 1726 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 09:41:33.898327 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-be7deb1e-f293-4323-9de9-f0bbe41343b7 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:41:33.901652 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-be7deb1e-f293-4323-9de9-f0bbe41343b7 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] [instance: e3dd8a17-5a2f-4f39-a110-208165e07110] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:41:33.919363 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-be7deb1e-f293-4323-9de9-f0bbe41343b7 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:41:33.920149 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-be7deb1e-f293-4323-9de9-f0bbe41343b7 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:41:33.921401 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-be7deb1e-f293-4323-9de9-f0bbe41343b7 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:41:33.922424 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-be7deb1e-f293-4323-9de9-f0bbe41343b7 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:41:34.031480 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-be7deb1e-f293-4323-9de9-f0bbe41343b7 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "POST /compute/v2.1/servers/e3dd8a17-5a2f-4f39-a110-208165e07110/action" status: 200 len: 38263 microversion: 2.20 time: 0.142324 Jan 21 09:41:34.032444 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 461/923] 10.222.0.45 () {62 vars in 1318 bytes} [Fri Jan 21 09:41:33 2022] POST /compute/v2.1/servers/e3dd8a17-5a2f-4f39-a110-208165e07110/action => generated 38263 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 21 09:41:34.194508 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-1b6e519d-2795-41f4-a273-5753b23a342b tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:41:34.195707 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-1b6e519d-2795-41f4-a273-5753b23a342b tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] [instance: 9c18953a-7af3-4d71-97ad-05eda7e34a73] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:41:34.207849 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-1b6e519d-2795-41f4-a273-5753b23a342b tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:41:34.208819 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-1b6e519d-2795-41f4-a273-5753b23a342b tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:41:34.210335 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-1b6e519d-2795-41f4-a273-5753b23a342b tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:41:34.211202 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-1b6e519d-2795-41f4-a273-5753b23a342b tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:41:34.479750 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-1b6e519d-2795-41f4-a273-5753b23a342b tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '590e721135c84df5946147ac7e944fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2322cb784615409bb15a6f49522d3b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:41:34.495548 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-1b6e519d-2795-41f4-a273-5753b23a342b tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] 10.222.0.45 "GET /compute/v2.1/servers/9c18953a-7af3-4d71-97ad-05eda7e34a73" status: 200 len: 1703 microversion: 2.1 time: 0.308485 Jan 21 09:41:34.500850 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 463/924] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:41:34 2022] GET /compute/v2.1/servers/9c18953a-7af3-4d71-97ad-05eda7e34a73 => generated 1703 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:41:34.524516 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-e0b74ade-8ea6-4efc-a3ee-6541b180b240 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:41:34.552269 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-e0b74ade-8ea6-4efc-a3ee-6541b180b240 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:41:34.554820 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-e0b74ade-8ea6-4efc-a3ee-6541b180b240 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:41:34.603232 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-e0b74ade-8ea6-4efc-a3ee-6541b180b240 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] [instance: 9c18953a-7af3-4d71-97ad-05eda7e34a73] Going to try to start instance {{(pid=123386) start /opt/stack/nova/nova/compute/api.py:2677}} Jan 21 09:41:34.835453 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-e0b74ade-8ea6-4efc-a3ee-6541b180b240 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] 10.222.0.45 "POST /compute/v2.1/servers/9c18953a-7af3-4d71-97ad-05eda7e34a73/action" status: 202 len: 0 microversion: 2.1 time: 0.320120 Jan 21 09:41:34.836352 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 462/925] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Jan 21 09:41:34 2022] POST /compute/v2.1/servers/9c18953a-7af3-4d71-97ad-05eda7e34a73/action => generated 0 bytes in 323 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 21 09:41:34.851786 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-e22017fc-3c91-48ad-80d0-e6e9bb597d9c tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:41:34.854119 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-e22017fc-3c91-48ad-80d0-e6e9bb597d9c tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] [instance: 9c18953a-7af3-4d71-97ad-05eda7e34a73] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:41:34.874000 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-e22017fc-3c91-48ad-80d0-e6e9bb597d9c tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:41:34.875120 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-e22017fc-3c91-48ad-80d0-e6e9bb597d9c tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:41:34.877259 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-e22017fc-3c91-48ad-80d0-e6e9bb597d9c tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:41:34.878760 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-e22017fc-3c91-48ad-80d0-e6e9bb597d9c tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:41:35.052257 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-9928148d-faf1-4838-979e-5da4bcac3b3f tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:41:35.060178 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-9928148d-faf1-4838-979e-5da4bcac3b3f tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] [instance: e3dd8a17-5a2f-4f39-a110-208165e07110] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:41:35.088026 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-9928148d-faf1-4838-979e-5da4bcac3b3f tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:41:35.088620 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-9928148d-faf1-4838-979e-5da4bcac3b3f tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:41:35.089638 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-9928148d-faf1-4838-979e-5da4bcac3b3f tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:41:35.090152 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-9928148d-faf1-4838-979e-5da4bcac3b3f tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:41:35.208537 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-9928148d-faf1-4838-979e-5da4bcac3b3f tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "POST /compute/v2.1/servers/e3dd8a17-5a2f-4f39-a110-208165e07110/action" status: 200 len: 38263 microversion: 2.20 time: 0.165106 Jan 21 09:41:35.228976 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 463/926] 10.222.0.45 () {62 vars in 1318 bytes} [Fri Jan 21 09:41:35 2022] POST /compute/v2.1/servers/e3dd8a17-5a2f-4f39-a110-208165e07110/action => generated 38263 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 21 09:41:35.415157 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-e22017fc-3c91-48ad-80d0-e6e9bb597d9c tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '590e721135c84df5946147ac7e944fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2322cb784615409bb15a6f49522d3b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:41:35.437123 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-e22017fc-3c91-48ad-80d0-e6e9bb597d9c tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] 10.222.0.45 "GET /compute/v2.1/servers/9c18953a-7af3-4d71-97ad-05eda7e34a73" status: 200 len: 1712 microversion: 2.1 time: 0.592753 Jan 21 09:41:35.438867 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 464/927] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:41:34 2022] GET /compute/v2.1/servers/9c18953a-7af3-4d71-97ad-05eda7e34a73 => generated 1712 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:41:36.235623 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-813953b2-1e90-437d-874d-2437c6d0dae3 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:41:36.236642 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-813953b2-1e90-437d-874d-2437c6d0dae3 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] [instance: e3dd8a17-5a2f-4f39-a110-208165e07110] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:41:36.252137 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-813953b2-1e90-437d-874d-2437c6d0dae3 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:41:36.253020 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-813953b2-1e90-437d-874d-2437c6d0dae3 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:41:36.254299 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-813953b2-1e90-437d-874d-2437c6d0dae3 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:41:36.254943 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-813953b2-1e90-437d-874d-2437c6d0dae3 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:41:36.384307 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-813953b2-1e90-437d-874d-2437c6d0dae3 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "POST /compute/v2.1/servers/e3dd8a17-5a2f-4f39-a110-208165e07110/action" status: 200 len: 38263 microversion: 2.20 time: 0.152251 Jan 21 09:41:36.389506 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 464/928] 10.222.0.45 () {62 vars in 1318 bytes} [Fri Jan 21 09:41:36 2022] POST /compute/v2.1/servers/e3dd8a17-5a2f-4f39-a110-208165e07110/action => generated 38263 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 21 09:41:36.467585 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-85f7c2b1-62f5-4e8f-b49a-c9c1be5601de tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:41:36.470103 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-85f7c2b1-62f5-4e8f-b49a-c9c1be5601de tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] [instance: 9c18953a-7af3-4d71-97ad-05eda7e34a73] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:41:36.494104 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-85f7c2b1-62f5-4e8f-b49a-c9c1be5601de tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:41:36.496399 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-85f7c2b1-62f5-4e8f-b49a-c9c1be5601de tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:41:36.497921 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-85f7c2b1-62f5-4e8f-b49a-c9c1be5601de tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:41:36.498713 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-85f7c2b1-62f5-4e8f-b49a-c9c1be5601de tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:41:37.292105 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-85f7c2b1-62f5-4e8f-b49a-c9c1be5601de tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '590e721135c84df5946147ac7e944fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2322cb784615409bb15a6f49522d3b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:41:37.310833 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-85f7c2b1-62f5-4e8f-b49a-c9c1be5601de tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] 10.222.0.45 "GET /compute/v2.1/servers/9c18953a-7af3-4d71-97ad-05eda7e34a73" status: 200 len: 1712 microversion: 2.1 time: 0.849877 Jan 21 09:41:37.318707 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 465/929] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:41:36 2022] GET /compute/v2.1/servers/9c18953a-7af3-4d71-97ad-05eda7e34a73 => generated 1712 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:41:37.404109 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-fb0b7f91-b956-49d1-b3bf-99e92a737d2e tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:41:37.406424 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-fb0b7f91-b956-49d1-b3bf-99e92a737d2e tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] [instance: e3dd8a17-5a2f-4f39-a110-208165e07110] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:41:37.417003 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-fb0b7f91-b956-49d1-b3bf-99e92a737d2e tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:41:37.417608 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-fb0b7f91-b956-49d1-b3bf-99e92a737d2e tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:41:37.418881 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-fb0b7f91-b956-49d1-b3bf-99e92a737d2e tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:41:37.419616 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-fb0b7f91-b956-49d1-b3bf-99e92a737d2e tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:41:37.512254 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-fb0b7f91-b956-49d1-b3bf-99e92a737d2e tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "POST /compute/v2.1/servers/e3dd8a17-5a2f-4f39-a110-208165e07110/action" status: 200 len: 38273 microversion: 2.20 time: 0.116339 Jan 21 09:41:37.513586 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 465/930] 10.222.0.45 () {62 vars in 1318 bytes} [Fri Jan 21 09:41:37 2022] POST /compute/v2.1/servers/e3dd8a17-5a2f-4f39-a110-208165e07110/action => generated 38273 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jan 21 09:41:38.330733 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-bd73cc27-2eaa-457c-aaba-91ee6bdf8bc0 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:41:38.332367 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-bd73cc27-2eaa-457c-aaba-91ee6bdf8bc0 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] [instance: 9c18953a-7af3-4d71-97ad-05eda7e34a73] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:41:38.342721 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-bd73cc27-2eaa-457c-aaba-91ee6bdf8bc0 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:41:38.347029 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-bd73cc27-2eaa-457c-aaba-91ee6bdf8bc0 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:41:38.348210 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-bd73cc27-2eaa-457c-aaba-91ee6bdf8bc0 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:41:38.348867 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-bd73cc27-2eaa-457c-aaba-91ee6bdf8bc0 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:41:38.531375 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-9e40f7a9-3cfd-444e-a637-201ebec5cbb8 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:41:38.532774 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-9e40f7a9-3cfd-444e-a637-201ebec5cbb8 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] [instance: e3dd8a17-5a2f-4f39-a110-208165e07110] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:41:38.542238 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-9e40f7a9-3cfd-444e-a637-201ebec5cbb8 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:41:38.543102 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-9e40f7a9-3cfd-444e-a637-201ebec5cbb8 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:41:38.544184 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-9e40f7a9-3cfd-444e-a637-201ebec5cbb8 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:41:38.544957 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-9e40f7a9-3cfd-444e-a637-201ebec5cbb8 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:41:38.624113 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-9e40f7a9-3cfd-444e-a637-201ebec5cbb8 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "POST /compute/v2.1/servers/e3dd8a17-5a2f-4f39-a110-208165e07110/action" status: 200 len: 38404 microversion: 2.20 time: 0.098979 Jan 21 09:41:38.624797 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 466/931] 10.222.0.45 () {62 vars in 1318 bytes} [Fri Jan 21 09:41:38 2022] POST /compute/v2.1/servers/e3dd8a17-5a2f-4f39-a110-208165e07110/action => generated 38404 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jan 21 09:41:38.640074 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-9008bf7a-c4c2-4a12-bec5-dcd03e6e6e8d tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:41:38.641332 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-9008bf7a-c4c2-4a12-bec5-dcd03e6e6e8d tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] [instance: e3dd8a17-5a2f-4f39-a110-208165e07110] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:41:38.650598 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-9008bf7a-c4c2-4a12-bec5-dcd03e6e6e8d tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:41:38.651454 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-9008bf7a-c4c2-4a12-bec5-dcd03e6e6e8d tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:41:38.652575 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-9008bf7a-c4c2-4a12-bec5-dcd03e6e6e8d tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:41:38.653284 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-9008bf7a-c4c2-4a12-bec5-dcd03e6e6e8d tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:41:38.681305 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-9008bf7a-c4c2-4a12-bec5-dcd03e6e6e8d tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "GET /compute/v2.1/servers/e3dd8a17-5a2f-4f39-a110-208165e07110/ips" status: 200 len: 153 microversion: 2.20 time: 0.047683 Jan 21 09:41:38.682195 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 467/932] 10.222.0.45 () {60 vars in 1288 bytes} [Fri Jan 21 09:41:38 2022] GET /compute/v2.1/servers/e3dd8a17-5a2f-4f39-a110-208165e07110/ips => generated 153 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 21 09:41:38.779737 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-bd73cc27-2eaa-457c-aaba-91ee6bdf8bc0 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '590e721135c84df5946147ac7e944fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2322cb784615409bb15a6f49522d3b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:41:38.794508 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-bd73cc27-2eaa-457c-aaba-91ee6bdf8bc0 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] 10.222.0.45 "GET /compute/v2.1/servers/9c18953a-7af3-4d71-97ad-05eda7e34a73" status: 200 len: 1716 microversion: 2.1 time: 0.467751 Jan 21 09:41:38.796334 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 466/933] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:41:38 2022] GET /compute/v2.1/servers/9c18953a-7af3-4d71-97ad-05eda7e34a73 => generated 1716 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 09:41:41.159468 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-a1e30fd1-098f-4015-9007-d6ca5036afaa tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:41:41.163613 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-a1e30fd1-098f-4015-9007-d6ca5036afaa tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] [instance: e3dd8a17-5a2f-4f39-a110-208165e07110] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:41:41.173616 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-a1e30fd1-098f-4015-9007-d6ca5036afaa tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:41:41.174708 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-a1e30fd1-098f-4015-9007-d6ca5036afaa tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:41:41.176301 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-a1e30fd1-098f-4015-9007-d6ca5036afaa tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:41:41.177424 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-a1e30fd1-098f-4015-9007-d6ca5036afaa tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:41:41.217477 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.objects.instance [None req-a1e30fd1-098f-4015-9007-d6ca5036afaa tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lazy-loading 'flavor' on Instance uuid e3dd8a17-5a2f-4f39-a110-208165e07110 {{(pid=123386) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 21 09:41:42.279241 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-a1e30fd1-098f-4015-9007-d6ca5036afaa tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "POST /compute/v2.1/servers/e3dd8a17-5a2f-4f39-a110-208165e07110/action" status: 202 len: 0 microversion: 2.20 time: 1.125954 Jan 21 09:41:42.280309 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 468/934] 10.222.0.45 () {62 vars in 1318 bytes} [Fri Jan 21 09:41:41 2022] POST /compute/v2.1/servers/e3dd8a17-5a2f-4f39-a110-208165e07110/action => generated 0 bytes in 1128 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jan 21 09:41:42.294122 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-5bcd6f4c-a1c7-467d-880e-3d520800eb84 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:41:42.297501 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-5bcd6f4c-a1c7-467d-880e-3d520800eb84 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] [instance: e3dd8a17-5a2f-4f39-a110-208165e07110] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:41:42.326301 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-5bcd6f4c-a1c7-467d-880e-3d520800eb84 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:41:42.326872 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-5bcd6f4c-a1c7-467d-880e-3d520800eb84 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:41:42.328102 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-5bcd6f4c-a1c7-467d-880e-3d520800eb84 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:41:42.331949 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-5bcd6f4c-a1c7-467d-880e-3d520800eb84 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:41:42.674059 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-5bcd6f4c-a1c7-467d-880e-3d520800eb84 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:41:42.689595 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-5bcd6f4c-a1c7-467d-880e-3d520800eb84 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:41:42.693527 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-5bcd6f4c-a1c7-467d-880e-3d520800eb84 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:41:42.695720 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-5bcd6f4c-a1c7-467d-880e-3d520800eb84 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "GET /compute/v2.1/servers/e3dd8a17-5a2f-4f39-a110-208165e07110" status: 200 len: 1724 microversion: 2.20 time: 0.408138 Jan 21 09:41:42.696557 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 467/935] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jan 21 09:41:42 2022] GET /compute/v2.1/servers/e3dd8a17-5a2f-4f39-a110-208165e07110 => generated 1724 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 21 09:41:42.893564 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-e0d26772-63d7-4313-9008-906da56a70fb tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Action: 'create', calling method: .version_select at 0x7fb6c2ba9af0>, body: {"keypair": {"name": "tempest-TestShelveInstance-476819569"}} {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:41:42.911783 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.quota [None req-e0d26772-63d7-4313-9008-906da56a70fb tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Getting quotas for project d2ac0334d1e14c29aa6222d547c64b00. Resources: {'key_pairs'} {{(pid=123386) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 21 09:41:42.917072 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.quota [None req-e0d26772-63d7-4313-9008-906da56a70fb tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Getting quotas for user 6aed8f68a416468cb303ae6c59a2203c and project d2ac0334d1e14c29aa6222d547c64b00. Resources: {'key_pairs'} {{(pid=123386) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 21 09:41:42.937081 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: ERROR oslo.messaging._drivers.impl_rabbit [None req-e0d26772-63d7-4313-9008-906da56a70fb tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] [cd0cfd0c-c7f2-448a-a881-41479674026f] AMQP server on 10.222.0.45:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jan 21 09:41:43.725071 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-9c963421-f8b9-4bdc-adb8-52d06414cbbc tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:41:43.726207 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-9c963421-f8b9-4bdc-adb8-52d06414cbbc tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] [instance: e3dd8a17-5a2f-4f39-a110-208165e07110] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:41:43.736422 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-9c963421-f8b9-4bdc-adb8-52d06414cbbc tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:41:43.737894 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-9c963421-f8b9-4bdc-adb8-52d06414cbbc tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:41:43.739246 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-9c963421-f8b9-4bdc-adb8-52d06414cbbc tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:41:43.739967 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-9c963421-f8b9-4bdc-adb8-52d06414cbbc tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:41:43.949356 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO oslo.messaging._drivers.impl_rabbit [None req-e0d26772-63d7-4313-9008-906da56a70fb tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] [cd0cfd0c-c7f2-448a-a881-41479674026f] Reconnected to AMQP server on 10.222.0.45:5672 via [amqp] client with port 34858. Jan 21 09:41:43.970255 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-9c963421-f8b9-4bdc-adb8-52d06414cbbc tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:41:43.986253 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-9c963421-f8b9-4bdc-adb8-52d06414cbbc tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:41:43.990487 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-9c963421-f8b9-4bdc-adb8-52d06414cbbc tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:41:43.992873 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-9c963421-f8b9-4bdc-adb8-52d06414cbbc tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "GET /compute/v2.1/servers/e3dd8a17-5a2f-4f39-a110-208165e07110" status: 200 len: 1724 microversion: 2.20 time: 0.272313 Jan 21 09:41:43.994012 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 468/936] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jan 21 09:41:43 2022] GET /compute/v2.1/servers/e3dd8a17-5a2f-4f39-a110-208165e07110 => generated 1724 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 21 09:41:44.551363 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.quota [None req-e0d26772-63d7-4313-9008-906da56a70fb tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Getting quotas for project d2ac0334d1e14c29aa6222d547c64b00. Resources: {'key_pairs'} {{(pid=123386) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 21 09:41:44.557282 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.quota [None req-e0d26772-63d7-4313-9008-906da56a70fb tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Getting quotas for user 6aed8f68a416468cb303ae6c59a2203c and project d2ac0334d1e14c29aa6222d547c64b00. Resources: {'key_pairs'} {{(pid=123386) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 21 09:41:44.577393 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-e0d26772-63d7-4313-9008-906da56a70fb tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 2311 microversion: 2.1 time: 1.968422 Jan 21 09:41:44.586293 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 469/937] 10.222.0.45 () {60 vars in 1157 bytes} [Fri Jan 21 09:41:42 2022] POST /compute/v2.1/os-keypairs => generated 2311 bytes in 1972 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:41:45.021885 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-8b1e36ee-8348-4f2f-b825-6a4ec66a52e6 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:41:45.023238 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-8b1e36ee-8348-4f2f-b825-6a4ec66a52e6 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] [instance: e3dd8a17-5a2f-4f39-a110-208165e07110] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:41:45.031181 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-8b1e36ee-8348-4f2f-b825-6a4ec66a52e6 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:41:45.031992 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-8b1e36ee-8348-4f2f-b825-6a4ec66a52e6 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:41:45.033046 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-8b1e36ee-8348-4f2f-b825-6a4ec66a52e6 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:41:45.035057 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-8b1e36ee-8348-4f2f-b825-6a4ec66a52e6 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:41:45.292711 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-8b1e36ee-8348-4f2f-b825-6a4ec66a52e6 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:41:45.304227 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-8b1e36ee-8348-4f2f-b825-6a4ec66a52e6 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:41:45.314269 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-8b1e36ee-8348-4f2f-b825-6a4ec66a52e6 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:41:45.317506 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-8b1e36ee-8348-4f2f-b825-6a4ec66a52e6 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "GET /compute/v2.1/servers/e3dd8a17-5a2f-4f39-a110-208165e07110" status: 200 len: 1724 microversion: 2.20 time: 0.300568 Jan 21 09:41:45.318174 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 469/938] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jan 21 09:41:45 2022] GET /compute/v2.1/servers/e3dd8a17-5a2f-4f39-a110-208165e07110 => generated 1724 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 21 09:41:46.344441 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-2662f982-6fdb-46c2-bf3f-249d531a0868 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:41:46.349099 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-2662f982-6fdb-46c2-bf3f-249d531a0868 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] [instance: e3dd8a17-5a2f-4f39-a110-208165e07110] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:41:46.360365 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-2662f982-6fdb-46c2-bf3f-249d531a0868 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:41:46.368372 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-2662f982-6fdb-46c2-bf3f-249d531a0868 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:41:46.368372 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-2662f982-6fdb-46c2-bf3f-249d531a0868 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:41:46.368372 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-2662f982-6fdb-46c2-bf3f-249d531a0868 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:41:46.608054 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-2662f982-6fdb-46c2-bf3f-249d531a0868 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:41:46.623948 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-2662f982-6fdb-46c2-bf3f-249d531a0868 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:41:46.627158 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-2662f982-6fdb-46c2-bf3f-249d531a0868 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:41:46.632722 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-2662f982-6fdb-46c2-bf3f-249d531a0868 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "GET /compute/v2.1/servers/e3dd8a17-5a2f-4f39-a110-208165e07110" status: 200 len: 1724 microversion: 2.20 time: 0.295349 Jan 21 09:41:46.632722 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 470/939] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jan 21 09:41:46 2022] GET /compute/v2.1/servers/e3dd8a17-5a2f-4f39-a110-208165e07110 => generated 1724 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 21 09:41:47.669177 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-528c4686-f0d8-4495-bdcc-0c98ff418d9a tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:41:47.671592 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-528c4686-f0d8-4495-bdcc-0c98ff418d9a tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] [instance: e3dd8a17-5a2f-4f39-a110-208165e07110] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:41:47.682775 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-528c4686-f0d8-4495-bdcc-0c98ff418d9a tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:41:47.683410 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-528c4686-f0d8-4495-bdcc-0c98ff418d9a tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:41:47.701587 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-528c4686-f0d8-4495-bdcc-0c98ff418d9a tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:41:47.701587 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-528c4686-f0d8-4495-bdcc-0c98ff418d9a tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:41:47.857029 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-528c4686-f0d8-4495-bdcc-0c98ff418d9a tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:41:47.869044 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-528c4686-f0d8-4495-bdcc-0c98ff418d9a tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:41:47.871270 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-528c4686-f0d8-4495-bdcc-0c98ff418d9a tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:41:47.873008 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-528c4686-f0d8-4495-bdcc-0c98ff418d9a tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "GET /compute/v2.1/servers/e3dd8a17-5a2f-4f39-a110-208165e07110" status: 200 len: 1724 microversion: 2.20 time: 0.210221 Jan 21 09:41:47.873860 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 470/940] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jan 21 09:41:47 2022] GET /compute/v2.1/servers/e3dd8a17-5a2f-4f39-a110-208165e07110 => generated 1724 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 21 09:41:48.909257 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-7f8d66b4-5744-4489-8e14-7f1a711fdc91 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:41:48.910556 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-7f8d66b4-5744-4489-8e14-7f1a711fdc91 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] [instance: e3dd8a17-5a2f-4f39-a110-208165e07110] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:41:48.927245 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-7f8d66b4-5744-4489-8e14-7f1a711fdc91 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:41:48.928451 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-7f8d66b4-5744-4489-8e14-7f1a711fdc91 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:41:48.930621 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-7f8d66b4-5744-4489-8e14-7f1a711fdc91 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:41:48.931211 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-7f8d66b4-5744-4489-8e14-7f1a711fdc91 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:41:49.125338 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-7f8d66b4-5744-4489-8e14-7f1a711fdc91 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:41:49.140797 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-7f8d66b4-5744-4489-8e14-7f1a711fdc91 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:41:49.145223 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-7f8d66b4-5744-4489-8e14-7f1a711fdc91 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:41:49.147469 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-7f8d66b4-5744-4489-8e14-7f1a711fdc91 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "GET /compute/v2.1/servers/e3dd8a17-5a2f-4f39-a110-208165e07110" status: 200 len: 1724 microversion: 2.20 time: 0.248461 Jan 21 09:41:49.148510 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 471/941] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jan 21 09:41:48 2022] GET /compute/v2.1/servers/e3dd8a17-5a2f-4f39-a110-208165e07110 => generated 1724 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 21 09:41:50.175766 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-83ad5faa-4c87-4833-bd8c-87e8c82057ed tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:41:50.176627 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-83ad5faa-4c87-4833-bd8c-87e8c82057ed tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] [instance: e3dd8a17-5a2f-4f39-a110-208165e07110] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:41:50.186095 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-83ad5faa-4c87-4833-bd8c-87e8c82057ed tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:41:50.191277 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-83ad5faa-4c87-4833-bd8c-87e8c82057ed tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:41:50.191277 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-83ad5faa-4c87-4833-bd8c-87e8c82057ed tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:41:50.191277 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-83ad5faa-4c87-4833-bd8c-87e8c82057ed tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:41:50.358375 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-83ad5faa-4c87-4833-bd8c-87e8c82057ed tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:41:50.375155 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-83ad5faa-4c87-4833-bd8c-87e8c82057ed tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:41:50.379630 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-83ad5faa-4c87-4833-bd8c-87e8c82057ed tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:41:50.381880 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-83ad5faa-4c87-4833-bd8c-87e8c82057ed tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "GET /compute/v2.1/servers/e3dd8a17-5a2f-4f39-a110-208165e07110" status: 200 len: 1724 microversion: 2.20 time: 0.210253 Jan 21 09:41:50.382973 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 471/942] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jan 21 09:41:50 2022] GET /compute/v2.1/servers/e3dd8a17-5a2f-4f39-a110-208165e07110 => generated 1724 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 21 09:41:51.402067 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-c733d440-afa2-4e43-a3ea-cce4577e139b tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:41:51.402751 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-c733d440-afa2-4e43-a3ea-cce4577e139b tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] [instance: e3dd8a17-5a2f-4f39-a110-208165e07110] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:41:51.410279 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-c733d440-afa2-4e43-a3ea-cce4577e139b tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:41:51.410763 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-c733d440-afa2-4e43-a3ea-cce4577e139b tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:41:51.411571 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-c733d440-afa2-4e43-a3ea-cce4577e139b tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:41:51.412043 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-c733d440-afa2-4e43-a3ea-cce4577e139b tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:41:51.581978 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-c733d440-afa2-4e43-a3ea-cce4577e139b tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:41:51.591155 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-c733d440-afa2-4e43-a3ea-cce4577e139b tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:41:51.592657 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-c733d440-afa2-4e43-a3ea-cce4577e139b tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:41:51.593898 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-c733d440-afa2-4e43-a3ea-cce4577e139b tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "GET /compute/v2.1/servers/e3dd8a17-5a2f-4f39-a110-208165e07110" status: 200 len: 1724 microversion: 2.20 time: 0.195942 Jan 21 09:41:51.594454 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 472/943] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jan 21 09:41:51 2022] GET /compute/v2.1/servers/e3dd8a17-5a2f-4f39-a110-208165e07110 => generated 1724 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 21 09:41:52.615585 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-d38c03db-2096-4283-9f2c-05dd6bbc9ead tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:41:52.616318 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-d38c03db-2096-4283-9f2c-05dd6bbc9ead tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] [instance: e3dd8a17-5a2f-4f39-a110-208165e07110] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:41:52.623488 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-d38c03db-2096-4283-9f2c-05dd6bbc9ead tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:41:52.623995 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-d38c03db-2096-4283-9f2c-05dd6bbc9ead tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:41:52.624929 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-d38c03db-2096-4283-9f2c-05dd6bbc9ead tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:41:52.625557 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-d38c03db-2096-4283-9f2c-05dd6bbc9ead tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:41:52.818699 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-d38c03db-2096-4283-9f2c-05dd6bbc9ead tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:41:52.827708 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-d38c03db-2096-4283-9f2c-05dd6bbc9ead tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:41:52.829650 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-d38c03db-2096-4283-9f2c-05dd6bbc9ead tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:41:52.831689 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-d38c03db-2096-4283-9f2c-05dd6bbc9ead tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "GET /compute/v2.1/servers/e3dd8a17-5a2f-4f39-a110-208165e07110" status: 200 len: 1724 microversion: 2.20 time: 0.222099 Jan 21 09:41:52.832652 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 472/944] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jan 21 09:41:52 2022] GET /compute/v2.1/servers/e3dd8a17-5a2f-4f39-a110-208165e07110 => generated 1724 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 21 09:41:53.867122 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-7b419b7b-602d-4ebd-bfc7-474f72695854 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:41:53.868209 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-7b419b7b-602d-4ebd-bfc7-474f72695854 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] [instance: e3dd8a17-5a2f-4f39-a110-208165e07110] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:41:53.880288 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-7b419b7b-602d-4ebd-bfc7-474f72695854 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:41:53.881080 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-7b419b7b-602d-4ebd-bfc7-474f72695854 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:41:53.882591 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-7b419b7b-602d-4ebd-bfc7-474f72695854 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:41:53.883393 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-7b419b7b-602d-4ebd-bfc7-474f72695854 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:41:54.086239 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-7b419b7b-602d-4ebd-bfc7-474f72695854 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:41:54.101685 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-7b419b7b-602d-4ebd-bfc7-474f72695854 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:41:54.104988 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-7b419b7b-602d-4ebd-bfc7-474f72695854 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:41:54.107623 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-7b419b7b-602d-4ebd-bfc7-474f72695854 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "GET /compute/v2.1/servers/e3dd8a17-5a2f-4f39-a110-208165e07110" status: 200 len: 1745 microversion: 2.20 time: 0.247929 Jan 21 09:41:54.108680 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 473/945] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jan 21 09:41:53 2022] GET /compute/v2.1/servers/e3dd8a17-5a2f-4f39-a110-208165e07110 => generated 1745 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 21 09:41:55.137988 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-8a7beb14-63a0-42b0-ac21-cc3b9515f93e tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:41:55.139509 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-8a7beb14-63a0-42b0-ac21-cc3b9515f93e tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] [instance: e3dd8a17-5a2f-4f39-a110-208165e07110] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:41:55.148909 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-8a7beb14-63a0-42b0-ac21-cc3b9515f93e tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:41:55.154054 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-8a7beb14-63a0-42b0-ac21-cc3b9515f93e tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:41:55.154054 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-8a7beb14-63a0-42b0-ac21-cc3b9515f93e tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:41:55.154054 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-8a7beb14-63a0-42b0-ac21-cc3b9515f93e tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:41:55.371997 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-8a7beb14-63a0-42b0-ac21-cc3b9515f93e tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:41:55.384167 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-8a7beb14-63a0-42b0-ac21-cc3b9515f93e tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:41:55.386575 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-8a7beb14-63a0-42b0-ac21-cc3b9515f93e tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:41:55.389512 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-8a7beb14-63a0-42b0-ac21-cc3b9515f93e tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "GET /compute/v2.1/servers/e3dd8a17-5a2f-4f39-a110-208165e07110" status: 200 len: 1745 microversion: 2.20 time: 0.254830 Jan 21 09:41:55.403240 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 473/946] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jan 21 09:41:55 2022] GET /compute/v2.1/servers/e3dd8a17-5a2f-4f39-a110-208165e07110 => generated 1745 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 21 09:41:55.975140 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [req-c7f59a5a-c7d6-4ba0-8adb-5b404a6118ad req-8ac8bfd6-8b33-40ba-947c-cdf675bef41b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3dd8a17-5a2f-4f39-a110-208165e07110", "name": "network-vif-plugged", "status": "completed", "tag": "248e29e3-d311-4074-bc03-c8c881428352"}]} {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:41:55.976943 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 21 09:41:55.976943 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: warnings.warn(msg) Jan 21 09:41:55.985296 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [req-c7f59a5a-c7d6-4ba0-8adb-5b404a6118ad req-8ac8bfd6-8b33-40ba-947c-cdf675bef41b service nova] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:41:55.985754 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [req-c7f59a5a-c7d6-4ba0-8adb-5b404a6118ad req-8ac8bfd6-8b33-40ba-947c-cdf675bef41b service nova] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:41:56.000444 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.compute.server_external_events [req-c7f59a5a-c7d6-4ba0-8adb-5b404a6118ad req-8ac8bfd6-8b33-40ba-947c-cdf675bef41b service nova] Creating event network-vif-plugged:248e29e3-d311-4074-bc03-c8c881428352 for instance e3dd8a17-5a2f-4f39-a110-208165e07110 on hv-cinder-80403 Jan 21 09:41:56.007720 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [req-c7f59a5a-c7d6-4ba0-8adb-5b404a6118ad req-8ac8bfd6-8b33-40ba-947c-cdf675bef41b service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.125633 Jan 21 09:41:56.008358 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 474/947] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Jan 21 09:41:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 09:41:56.426123 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-b6e96833-fb87-4ddd-a9a2-eaac4cedb524 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:41:56.428399 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-b6e96833-fb87-4ddd-a9a2-eaac4cedb524 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] [instance: e3dd8a17-5a2f-4f39-a110-208165e07110] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:41:56.452658 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-b6e96833-fb87-4ddd-a9a2-eaac4cedb524 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:41:56.458985 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-b6e96833-fb87-4ddd-a9a2-eaac4cedb524 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:41:56.461331 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-b6e96833-fb87-4ddd-a9a2-eaac4cedb524 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:41:56.465783 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-b6e96833-fb87-4ddd-a9a2-eaac4cedb524 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:41:56.763154 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-b6e96833-fb87-4ddd-a9a2-eaac4cedb524 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:41:56.783779 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-b6e96833-fb87-4ddd-a9a2-eaac4cedb524 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:41:56.789260 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-b6e96833-fb87-4ddd-a9a2-eaac4cedb524 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:41:56.791866 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-b6e96833-fb87-4ddd-a9a2-eaac4cedb524 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "GET /compute/v2.1/servers/e3dd8a17-5a2f-4f39-a110-208165e07110" status: 200 len: 1740 microversion: 2.20 time: 0.376265 Jan 21 09:41:56.793219 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 474/948] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jan 21 09:41:56 2022] GET /compute/v2.1/servers/e3dd8a17-5a2f-4f39-a110-208165e07110 => generated 1740 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 21 09:41:57.828208 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-339779d9-04c3-47a7-a398-d1b35ef8e683 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:41:57.831216 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-339779d9-04c3-47a7-a398-d1b35ef8e683 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] [instance: e3dd8a17-5a2f-4f39-a110-208165e07110] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:41:57.843761 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-339779d9-04c3-47a7-a398-d1b35ef8e683 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:41:57.845286 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-339779d9-04c3-47a7-a398-d1b35ef8e683 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:41:57.847607 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-339779d9-04c3-47a7-a398-d1b35ef8e683 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:41:57.848667 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-339779d9-04c3-47a7-a398-d1b35ef8e683 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:41:58.141602 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-339779d9-04c3-47a7-a398-d1b35ef8e683 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:41:58.159463 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-339779d9-04c3-47a7-a398-d1b35ef8e683 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:41:58.162838 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-339779d9-04c3-47a7-a398-d1b35ef8e683 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:41:58.165607 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-339779d9-04c3-47a7-a398-d1b35ef8e683 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "GET /compute/v2.1/servers/e3dd8a17-5a2f-4f39-a110-208165e07110" status: 200 len: 1740 microversion: 2.20 time: 0.344669 Jan 21 09:41:58.167235 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 475/949] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jan 21 09:41:57 2022] GET /compute/v2.1/servers/e3dd8a17-5a2f-4f39-a110-208165e07110 => generated 1740 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 21 09:41:59.198495 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-b4770236-6e3c-44d9-ba56-7df9c79c2482 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:41:59.200506 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-b4770236-6e3c-44d9-ba56-7df9c79c2482 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] [instance: e3dd8a17-5a2f-4f39-a110-208165e07110] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:41:59.211543 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-b4770236-6e3c-44d9-ba56-7df9c79c2482 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:41:59.212707 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-b4770236-6e3c-44d9-ba56-7df9c79c2482 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:41:59.214045 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-b4770236-6e3c-44d9-ba56-7df9c79c2482 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:41:59.214802 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-b4770236-6e3c-44d9-ba56-7df9c79c2482 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:41:59.435484 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-b4770236-6e3c-44d9-ba56-7df9c79c2482 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:41:59.450866 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-b4770236-6e3c-44d9-ba56-7df9c79c2482 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:41:59.454759 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-b4770236-6e3c-44d9-ba56-7df9c79c2482 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:41:59.457538 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-b4770236-6e3c-44d9-ba56-7df9c79c2482 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "GET /compute/v2.1/servers/e3dd8a17-5a2f-4f39-a110-208165e07110" status: 200 len: 1740 microversion: 2.20 time: 0.265182 Jan 21 09:41:59.458419 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 475/950] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jan 21 09:41:59 2022] GET /compute/v2.1/servers/e3dd8a17-5a2f-4f39-a110-208165e07110 => generated 1740 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 21 09:42:00.483533 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-9338a1f2-68ed-4fdb-a3bc-2c1b9d2f5d7d tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:42:00.484742 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-9338a1f2-68ed-4fdb-a3bc-2c1b9d2f5d7d tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] [instance: e3dd8a17-5a2f-4f39-a110-208165e07110] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:42:00.497310 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-9338a1f2-68ed-4fdb-a3bc-2c1b9d2f5d7d tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:42:00.498098 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-9338a1f2-68ed-4fdb-a3bc-2c1b9d2f5d7d tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:42:00.499964 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-9338a1f2-68ed-4fdb-a3bc-2c1b9d2f5d7d tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:42:00.500715 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-9338a1f2-68ed-4fdb-a3bc-2c1b9d2f5d7d tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:42:00.741812 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-9338a1f2-68ed-4fdb-a3bc-2c1b9d2f5d7d tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:42:00.761648 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-9338a1f2-68ed-4fdb-a3bc-2c1b9d2f5d7d tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:42:00.764420 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-9338a1f2-68ed-4fdb-a3bc-2c1b9d2f5d7d tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:42:00.767009 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-9338a1f2-68ed-4fdb-a3bc-2c1b9d2f5d7d tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "GET /compute/v2.1/servers/e3dd8a17-5a2f-4f39-a110-208165e07110" status: 200 len: 1740 microversion: 2.20 time: 0.290264 Jan 21 09:42:00.774942 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 476/951] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jan 21 09:42:00 2022] GET /compute/v2.1/servers/e3dd8a17-5a2f-4f39-a110-208165e07110 => generated 1740 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 21 09:42:01.810067 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-f4e1266b-121b-4dde-bbe3-9cf9653f35f6 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:42:01.812032 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-f4e1266b-121b-4dde-bbe3-9cf9653f35f6 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] [instance: e3dd8a17-5a2f-4f39-a110-208165e07110] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:42:01.822561 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-f4e1266b-121b-4dde-bbe3-9cf9653f35f6 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:42:01.823222 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-f4e1266b-121b-4dde-bbe3-9cf9653f35f6 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:42:01.824281 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-f4e1266b-121b-4dde-bbe3-9cf9653f35f6 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:42:01.824889 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-f4e1266b-121b-4dde-bbe3-9cf9653f35f6 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:42:02.040096 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-f4e1266b-121b-4dde-bbe3-9cf9653f35f6 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:42:02.050424 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-f4e1266b-121b-4dde-bbe3-9cf9653f35f6 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:42:02.051760 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-f4e1266b-121b-4dde-bbe3-9cf9653f35f6 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:42:02.052975 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-f4e1266b-121b-4dde-bbe3-9cf9653f35f6 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "GET /compute/v2.1/servers/e3dd8a17-5a2f-4f39-a110-208165e07110" status: 200 len: 1740 microversion: 2.20 time: 0.249427 Jan 21 09:42:02.053734 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 476/952] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jan 21 09:42:01 2022] GET /compute/v2.1/servers/e3dd8a17-5a2f-4f39-a110-208165e07110 => generated 1740 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 21 09:42:03.085545 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-f79643b0-bc1b-448b-8637-c43383560d29 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:42:03.086595 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-f79643b0-bc1b-448b-8637-c43383560d29 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] [instance: e3dd8a17-5a2f-4f39-a110-208165e07110] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:42:03.094626 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-f79643b0-bc1b-448b-8637-c43383560d29 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:42:03.097425 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-f79643b0-bc1b-448b-8637-c43383560d29 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:42:03.097425 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-f79643b0-bc1b-448b-8637-c43383560d29 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:42:03.098031 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-f79643b0-bc1b-448b-8637-c43383560d29 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:42:03.258315 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-f79643b0-bc1b-448b-8637-c43383560d29 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:42:03.267810 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-f79643b0-bc1b-448b-8637-c43383560d29 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:42:03.269512 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-f79643b0-bc1b-448b-8637-c43383560d29 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:42:03.270763 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-f79643b0-bc1b-448b-8637-c43383560d29 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "GET /compute/v2.1/servers/e3dd8a17-5a2f-4f39-a110-208165e07110" status: 200 len: 1740 microversion: 2.20 time: 0.192148 Jan 21 09:42:03.271340 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 477/953] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jan 21 09:42:03 2022] GET /compute/v2.1/servers/e3dd8a17-5a2f-4f39-a110-208165e07110 => generated 1740 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 21 09:42:03.463475 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-95b80435-b897-43cc-aece-4cd268db3be7 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:42:03.464929 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-95b80435-b897-43cc-aece-4cd268db3be7 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] [instance: 2733931f-f68e-4f48-85d2-5060a8f55eec] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:42:03.477334 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-95b80435-b897-43cc-aece-4cd268db3be7 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:42:03.478746 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-95b80435-b897-43cc-aece-4cd268db3be7 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:42:03.480817 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-95b80435-b897-43cc-aece-4cd268db3be7 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:42:03.482353 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-95b80435-b897-43cc-aece-4cd268db3be7 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:42:03.564076 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-95b80435-b897-43cc-aece-4cd268db3be7 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] [instance: 2733931f-f68e-4f48-85d2-5060a8f55eec] Going to try to terminate instance {{(pid=123387) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 21 09:42:03.965705 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-95b80435-b897-43cc-aece-4cd268db3be7 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] 10.222.0.45 "DELETE /compute/v2.1/servers/2733931f-f68e-4f48-85d2-5060a8f55eec" status: 204 len: 0 microversion: 2.1 time: 0.507808 Jan 21 09:42:03.967683 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 477/954] 10.222.0.45 () {58 vars in 1238 bytes} [Fri Jan 21 09:42:03 2022] DELETE /compute/v2.1/servers/2733931f-f68e-4f48-85d2-5060a8f55eec => generated 0 bytes in 511 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jan 21 09:42:03.980848 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-83318125-792b-49ee-87cb-2b8bffeb050b tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:42:03.982634 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-83318125-792b-49ee-87cb-2b8bffeb050b tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] [instance: 2733931f-f68e-4f48-85d2-5060a8f55eec] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:42:03.997865 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-83318125-792b-49ee-87cb-2b8bffeb050b tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:42:03.998761 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-83318125-792b-49ee-87cb-2b8bffeb050b tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:42:04.000507 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-83318125-792b-49ee-87cb-2b8bffeb050b tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:42:04.001341 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-83318125-792b-49ee-87cb-2b8bffeb050b tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:42:04.210392 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-cac31e28-55be-4a03-b5af-a94898bffa79 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1266579734", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-476819569", "security_groups": [{"name": "tempest-secgroup-smoke-311865400"}], "networks": [{"uuid": "ec6c0da2-1dbe-43af-89f3-68cb39bbc90b"}], "block_device_mapping_v2": [{"uuid": "4b8f6664-7783-4c96-84ae-5dc552ef9568", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:42:04.319936 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-83318125-792b-49ee-87cb-2b8bffeb050b tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d53a7fa2cb5498aa916817b82dba77e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515ded26ca114fbf9c6e920362aec64c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:42:04.337983 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-83318125-792b-49ee-87cb-2b8bffeb050b tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] 10.222.0.45 "GET /compute/v2.1/servers/2733931f-f68e-4f48-85d2-5060a8f55eec" status: 200 len: 1576 microversion: 2.1 time: 0.364161 Jan 21 09:42:04.340117 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 478/955] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:42:03 2022] GET /compute/v2.1/servers/2733931f-f68e-4f48-85d2-5060a8f55eec => generated 1576 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:42:04.349355 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-95da0be6-83f7-4279-95df-8160e8dc27a6 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:42:04.351181 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-95da0be6-83f7-4279-95df-8160e8dc27a6 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] [instance: e3dd8a17-5a2f-4f39-a110-208165e07110] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:42:04.363445 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-95da0be6-83f7-4279-95df-8160e8dc27a6 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:42:04.364673 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-95da0be6-83f7-4279-95df-8160e8dc27a6 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:42:04.366587 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-95da0be6-83f7-4279-95df-8160e8dc27a6 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:42:04.367740 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-95da0be6-83f7-4279-95df-8160e8dc27a6 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:42:04.550432 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.network.neutron [None req-cac31e28-55be-4a03-b5af-a94898bffa79 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] validate_networks() for [('ec6c0da2-1dbe-43af-89f3-68cb39bbc90b', None, None, None, None, None)] {{(pid=123387) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 21 09:42:04.788484 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-95da0be6-83f7-4279-95df-8160e8dc27a6 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:42:04.800223 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-95da0be6-83f7-4279-95df-8160e8dc27a6 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:42:04.802217 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-95da0be6-83f7-4279-95df-8160e8dc27a6 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:42:04.805426 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-95da0be6-83f7-4279-95df-8160e8dc27a6 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "GET /compute/v2.1/servers/e3dd8a17-5a2f-4f39-a110-208165e07110" status: 200 len: 1740 microversion: 2.20 time: 0.462470 Jan 21 09:42:04.806613 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 479/956] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jan 21 09:42:04 2022] GET /compute/v2.1/servers/e3dd8a17-5a2f-4f39-a110-208165e07110 => generated 1740 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 21 09:42:05.316020 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.virt.hardware [None req-cac31e28-55be-4a03-b5af-a94898bffa79 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Flavor limits 0:0:0 {{(pid=123387) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 21 09:42:05.316617 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.virt.hardware [None req-cac31e28-55be-4a03-b5af-a94898bffa79 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Image limits 0:0:0 {{(pid=123387) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 21 09:42:05.317337 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.virt.hardware [None req-cac31e28-55be-4a03-b5af-a94898bffa79 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Flavor pref 0:0:0 {{(pid=123387) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 21 09:42:05.317835 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.virt.hardware [None req-cac31e28-55be-4a03-b5af-a94898bffa79 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Image pref 0:0:0 {{(pid=123387) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 21 09:42:05.318448 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.virt.hardware [None req-cac31e28-55be-4a03-b5af-a94898bffa79 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123387) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 21 09:42:05.329986 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-cac31e28-55be-4a03-b5af-a94898bffa79 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:42:05.330628 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-cac31e28-55be-4a03-b5af-a94898bffa79 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:42:05.331833 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-cac31e28-55be-4a03-b5af-a94898bffa79 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:42:05.332311 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-cac31e28-55be-4a03-b5af-a94898bffa79 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:42:05.352072 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.quota [None req-cac31e28-55be-4a03-b5af-a94898bffa79 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Getting quotas for project d2ac0334d1e14c29aa6222d547c64b00. Resources: {'cores', 'instances', 'ram'} {{(pid=123387) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 21 09:42:05.358048 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.quota [None req-cac31e28-55be-4a03-b5af-a94898bffa79 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Getting quotas for user 6aed8f68a416468cb303ae6c59a2203c and project d2ac0334d1e14c29aa6222d547c64b00. Resources: {'cores', 'instances', 'ram'} {{(pid=123387) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 21 09:42:05.372540 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-0e8e291a-ddbc-4891-9283-7db76419d3ae tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:42:05.373483 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-0e8e291a-ddbc-4891-9283-7db76419d3ae tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] [instance: 2733931f-f68e-4f48-85d2-5060a8f55eec] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:42:05.385716 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-0e8e291a-ddbc-4891-9283-7db76419d3ae tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:42:05.386477 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-0e8e291a-ddbc-4891-9283-7db76419d3ae tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:42:05.387933 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-0e8e291a-ddbc-4891-9283-7db76419d3ae tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:42:05.389190 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-0e8e291a-ddbc-4891-9283-7db76419d3ae tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:42:05.431720 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-cac31e28-55be-4a03-b5af-a94898bffa79 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Going to run 1 instances... {{(pid=123387) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 21 09:42:05.442992 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-cac31e28-55be-4a03-b5af-a94898bffa79 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] [instance: f4a4e6b7-47b1-4de2-8677-4f8e3eb056c2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='4b8f6664-7783-4c96-84ae-5dc552ef9568',volume_size=None,volume_type=None)] {{(pid=123387) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 21 09:42:05.644540 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-0e8e291a-ddbc-4891-9283-7db76419d3ae tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d53a7fa2cb5498aa916817b82dba77e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515ded26ca114fbf9c6e920362aec64c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:42:05.654348 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-0e8e291a-ddbc-4891-9283-7db76419d3ae tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] 10.222.0.45 "GET /compute/v2.1/servers/2733931f-f68e-4f48-85d2-5060a8f55eec" status: 200 len: 1576 microversion: 2.1 time: 0.285703 Jan 21 09:42:05.659343 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 480/957] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:42:05 2022] GET /compute/v2.1/servers/2733931f-f68e-4f48-85d2-5060a8f55eec => generated 1576 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:42:05.843110 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-a4376f55-d1a5-4a47-8b44-63457c27f87c tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:42:05.846027 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-a4376f55-d1a5-4a47-8b44-63457c27f87c tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] [instance: e3dd8a17-5a2f-4f39-a110-208165e07110] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:42:05.863144 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-a4376f55-d1a5-4a47-8b44-63457c27f87c tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:42:05.864976 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-a4376f55-d1a5-4a47-8b44-63457c27f87c tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:42:05.866546 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-a4376f55-d1a5-4a47-8b44-63457c27f87c tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:42:05.867436 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-a4376f55-d1a5-4a47-8b44-63457c27f87c tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:42:06.082282 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-cac31e28-55be-4a03-b5af-a94898bffa79 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.879813 Jan 21 09:42:06.084609 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 478/958] 10.222.0.45 () {60 vars in 1146 bytes} [Fri Jan 21 09:42:04 2022] POST /compute/v2.1/servers => generated 405 bytes in 1884 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 21 09:42:06.105755 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-22102b56-d531-40bc-852b-ffc7c58ea25a tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:42:06.110290 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-22102b56-d531-40bc-852b-ffc7c58ea25a tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] [instance: f4a4e6b7-47b1-4de2-8677-4f8e3eb056c2] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:42:06.281875 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-22102b56-d531-40bc-852b-ffc7c58ea25a tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aed8f68a416468cb303ae6c59a2203c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ac0334d1e14c29aa6222d547c64b00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:42:06.296817 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-22102b56-d531-40bc-852b-ffc7c58ea25a tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] 10.222.0.45 "GET /compute/v2.1/servers/f4a4e6b7-47b1-4de2-8677-4f8e3eb056c2" status: 200 len: 1088 microversion: 2.1 time: 0.198538 Jan 21 09:42:06.297736 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 479/959] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:42:06 2022] GET /compute/v2.1/servers/f4a4e6b7-47b1-4de2-8677-4f8e3eb056c2 => generated 1088 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:42:06.367794 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-a4376f55-d1a5-4a47-8b44-63457c27f87c tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:42:06.383656 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-a4376f55-d1a5-4a47-8b44-63457c27f87c tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:42:06.385263 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-a4376f55-d1a5-4a47-8b44-63457c27f87c tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:42:06.388322 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-a4376f55-d1a5-4a47-8b44-63457c27f87c tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "GET /compute/v2.1/servers/e3dd8a17-5a2f-4f39-a110-208165e07110" status: 200 len: 1740 microversion: 2.20 time: 0.550470 Jan 21 09:42:06.388978 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 481/960] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jan 21 09:42:05 2022] GET /compute/v2.1/servers/e3dd8a17-5a2f-4f39-a110-208165e07110 => generated 1740 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 21 09:42:06.683765 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-87783186-8522-4985-8b0e-a574c16fc95d tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:42:06.684839 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-87783186-8522-4985-8b0e-a574c16fc95d tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] [instance: 2733931f-f68e-4f48-85d2-5060a8f55eec] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:42:06.715529 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-87783186-8522-4985-8b0e-a574c16fc95d tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:42:06.716322 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-87783186-8522-4985-8b0e-a574c16fc95d tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:42:06.717395 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-87783186-8522-4985-8b0e-a574c16fc95d tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:42:06.717954 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-87783186-8522-4985-8b0e-a574c16fc95d tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:42:07.023958 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-87783186-8522-4985-8b0e-a574c16fc95d tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d53a7fa2cb5498aa916817b82dba77e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515ded26ca114fbf9c6e920362aec64c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:42:07.040789 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-87783186-8522-4985-8b0e-a574c16fc95d tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] 10.222.0.45 "GET /compute/v2.1/servers/2733931f-f68e-4f48-85d2-5060a8f55eec" status: 200 len: 1576 microversion: 2.1 time: 0.360311 Jan 21 09:42:07.050682 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 480/961] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:42:06 2022] GET /compute/v2.1/servers/2733931f-f68e-4f48-85d2-5060a8f55eec => generated 1576 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 09:42:07.324358 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-953c4115-53ff-4cb0-9619-68622f9abafa tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:42:07.325604 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-953c4115-53ff-4cb0-9619-68622f9abafa tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] [instance: f4a4e6b7-47b1-4de2-8677-4f8e3eb056c2] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:42:07.410291 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-e55641cd-d04f-4f36-97fa-1eb44287aa7e tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:42:07.410985 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-e55641cd-d04f-4f36-97fa-1eb44287aa7e tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] [instance: e3dd8a17-5a2f-4f39-a110-208165e07110] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:42:07.419605 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-e55641cd-d04f-4f36-97fa-1eb44287aa7e tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:42:07.420050 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-e55641cd-d04f-4f36-97fa-1eb44287aa7e tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:42:07.420888 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-e55641cd-d04f-4f36-97fa-1eb44287aa7e tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:42:07.421365 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-e55641cd-d04f-4f36-97fa-1eb44287aa7e tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:42:07.467918 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-953c4115-53ff-4cb0-9619-68622f9abafa tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aed8f68a416468cb303ae6c59a2203c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ac0334d1e14c29aa6222d547c64b00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:42:07.477978 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-953c4115-53ff-4cb0-9619-68622f9abafa tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] 10.222.0.45 "GET /compute/v2.1/servers/f4a4e6b7-47b1-4de2-8677-4f8e3eb056c2" status: 200 len: 1088 microversion: 2.1 time: 0.163552 Jan 21 09:42:07.478920 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 482/962] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:42:07 2022] GET /compute/v2.1/servers/f4a4e6b7-47b1-4de2-8677-4f8e3eb056c2 => generated 1088 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:42:08.093313 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-fd5fd3c2-a483-4d00-833a-7d2486d15218 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:42:08.094530 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-fd5fd3c2-a483-4d00-833a-7d2486d15218 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] [instance: 2733931f-f68e-4f48-85d2-5060a8f55eec] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:42:08.115190 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-fd5fd3c2-a483-4d00-833a-7d2486d15218 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:42:08.123057 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-fd5fd3c2-a483-4d00-833a-7d2486d15218 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:42:08.124308 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-fd5fd3c2-a483-4d00-833a-7d2486d15218 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:42:08.134526 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-fd5fd3c2-a483-4d00-833a-7d2486d15218 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:42:08.223364 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-e55641cd-d04f-4f36-97fa-1eb44287aa7e tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:42:08.234119 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-e55641cd-d04f-4f36-97fa-1eb44287aa7e tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:42:08.237680 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-e55641cd-d04f-4f36-97fa-1eb44287aa7e tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:42:08.239763 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-e55641cd-d04f-4f36-97fa-1eb44287aa7e tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "GET /compute/v2.1/servers/e3dd8a17-5a2f-4f39-a110-208165e07110" status: 200 len: 1740 microversion: 2.20 time: 0.834973 Jan 21 09:42:08.241010 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 481/963] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jan 21 09:42:07 2022] GET /compute/v2.1/servers/e3dd8a17-5a2f-4f39-a110-208165e07110 => generated 1740 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 21 09:42:08.307253 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-fd5fd3c2-a483-4d00-833a-7d2486d15218 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d53a7fa2cb5498aa916817b82dba77e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515ded26ca114fbf9c6e920362aec64c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:42:08.329321 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-fd5fd3c2-a483-4d00-833a-7d2486d15218 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] 10.222.0.45 "GET /compute/v2.1/servers/2733931f-f68e-4f48-85d2-5060a8f55eec" status: 200 len: 1509 microversion: 2.1 time: 0.259615 Jan 21 09:42:08.342088 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 483/964] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:42:08 2022] GET /compute/v2.1/servers/2733931f-f68e-4f48-85d2-5060a8f55eec => generated 1509 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:42:08.501461 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-3be967bf-49e3-4f21-a694-6dc3f00d3831 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:42:08.506086 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-3be967bf-49e3-4f21-a694-6dc3f00d3831 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] [instance: f4a4e6b7-47b1-4de2-8677-4f8e3eb056c2] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:42:08.530465 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-3be967bf-49e3-4f21-a694-6dc3f00d3831 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:42:08.532184 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-3be967bf-49e3-4f21-a694-6dc3f00d3831 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:42:08.548575 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-3be967bf-49e3-4f21-a694-6dc3f00d3831 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:42:08.549620 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-3be967bf-49e3-4f21-a694-6dc3f00d3831 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:42:08.555178 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [req-15ec202d-a1c2-493c-9cbf-2d9776f04132 req-d6e7a286-fa77-4ddc-acae-88e52c71f9b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2733931f-f68e-4f48-85d2-5060a8f55eec", "name": "network-vif-deleted", "tag": "fdcd5489-3e9c-4a62-8bc8-26a5c193cc04"}]} {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:42:08.562584 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 21 09:42:08.562584 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: warnings.warn(msg) Jan 21 09:42:08.600511 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [req-15ec202d-a1c2-493c-9cbf-2d9776f04132 req-d6e7a286-fa77-4ddc-acae-88e52c71f9b2 service nova] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:42:08.602257 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [req-15ec202d-a1c2-493c-9cbf-2d9776f04132 req-d6e7a286-fa77-4ddc-acae-88e52c71f9b2 service nova] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:42:08.640501 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.compute.server_external_events [req-15ec202d-a1c2-493c-9cbf-2d9776f04132 req-d6e7a286-fa77-4ddc-acae-88e52c71f9b2 service nova] Creating event network-vif-deleted:fdcd5489-3e9c-4a62-8bc8-26a5c193cc04 for instance 2733931f-f68e-4f48-85d2-5060a8f55eec on hv-cinder-80403 Jan 21 09:42:08.672150 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [req-15ec202d-a1c2-493c-9cbf-2d9776f04132 req-d6e7a286-fa77-4ddc-acae-88e52c71f9b2 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.132816 Jan 21 09:42:08.674525 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 484/965] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Jan 21 09:42:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 09:42:08.773108 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-3be967bf-49e3-4f21-a694-6dc3f00d3831 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aed8f68a416468cb303ae6c59a2203c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ac0334d1e14c29aa6222d547c64b00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:42:08.790342 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-3be967bf-49e3-4f21-a694-6dc3f00d3831 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] 10.222.0.45 "GET /compute/v2.1/servers/f4a4e6b7-47b1-4de2-8677-4f8e3eb056c2" status: 200 len: 1130 microversion: 2.1 time: 0.295433 Jan 21 09:42:08.806232 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 482/966] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:42:08 2022] GET /compute/v2.1/servers/f4a4e6b7-47b1-4de2-8677-4f8e3eb056c2 => generated 1130 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:42:09.264730 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-bd94eff9-4de2-427f-a424-027988b7492d tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:42:09.265506 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-bd94eff9-4de2-427f-a424-027988b7492d tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] [instance: e3dd8a17-5a2f-4f39-a110-208165e07110] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:42:09.294582 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-bd94eff9-4de2-427f-a424-027988b7492d tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:42:09.294931 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-bd94eff9-4de2-427f-a424-027988b7492d tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:42:09.296426 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-bd94eff9-4de2-427f-a424-027988b7492d tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:42:09.297274 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-bd94eff9-4de2-427f-a424-027988b7492d tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:42:09.375273 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-e5c3c606-bdb4-4561-857b-5c08f6c01521 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:42:09.376419 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-e5c3c606-bdb4-4561-857b-5c08f6c01521 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] [instance: 2733931f-f68e-4f48-85d2-5060a8f55eec] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:42:09.402642 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-e5c3c606-bdb4-4561-857b-5c08f6c01521 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:42:09.406193 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-e5c3c606-bdb4-4561-857b-5c08f6c01521 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:42:09.408648 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-e5c3c606-bdb4-4561-857b-5c08f6c01521 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:42:09.412012 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-e5c3c606-bdb4-4561-857b-5c08f6c01521 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:42:09.532369 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-e5c3c606-bdb4-4561-857b-5c08f6c01521 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d53a7fa2cb5498aa916817b82dba77e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515ded26ca114fbf9c6e920362aec64c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:42:09.572315 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-e5c3c606-bdb4-4561-857b-5c08f6c01521 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] 10.222.0.45 "GET /compute/v2.1/servers/2733931f-f68e-4f48-85d2-5060a8f55eec" status: 200 len: 1225 microversion: 2.1 time: 0.226713 Jan 21 09:42:09.575418 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 483/967] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:42:09 2022] GET /compute/v2.1/servers/2733931f-f68e-4f48-85d2-5060a8f55eec => generated 1225 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:42:09.662365 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-bd94eff9-4de2-427f-a424-027988b7492d tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:42:09.691088 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-bd94eff9-4de2-427f-a424-027988b7492d tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:42:09.694902 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-bd94eff9-4de2-427f-a424-027988b7492d tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:42:09.697935 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-bd94eff9-4de2-427f-a424-027988b7492d tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "GET /compute/v2.1/servers/e3dd8a17-5a2f-4f39-a110-208165e07110" status: 200 len: 1740 microversion: 2.20 time: 0.437078 Jan 21 09:42:09.699012 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 485/968] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jan 21 09:42:09 2022] GET /compute/v2.1/servers/e3dd8a17-5a2f-4f39-a110-208165e07110 => generated 1740 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 21 09:42:09.825674 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-575829b4-7ceb-427e-bc5c-628f52f10b73 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:42:09.827347 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-575829b4-7ceb-427e-bc5c-628f52f10b73 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] [instance: f4a4e6b7-47b1-4de2-8677-4f8e3eb056c2] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:42:09.840516 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-575829b4-7ceb-427e-bc5c-628f52f10b73 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:42:09.841376 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-575829b4-7ceb-427e-bc5c-628f52f10b73 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:42:09.842947 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-575829b4-7ceb-427e-bc5c-628f52f10b73 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:42:09.843764 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-575829b4-7ceb-427e-bc5c-628f52f10b73 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:42:09.977552 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-575829b4-7ceb-427e-bc5c-628f52f10b73 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aed8f68a416468cb303ae6c59a2203c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ac0334d1e14c29aa6222d547c64b00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:42:09.993707 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-575829b4-7ceb-427e-bc5c-628f52f10b73 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] 10.222.0.45 "GET /compute/v2.1/servers/f4a4e6b7-47b1-4de2-8677-4f8e3eb056c2" status: 200 len: 1194 microversion: 2.1 time: 0.174017 Jan 21 09:42:09.994657 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 484/969] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:42:09 2022] GET /compute/v2.1/servers/f4a4e6b7-47b1-4de2-8677-4f8e3eb056c2 => generated 1194 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:42:10.591357 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-66b25c79-a148-48cb-8c91-f45284278987 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:42:10.592084 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-66b25c79-a148-48cb-8c91-f45284278987 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] [instance: 2733931f-f68e-4f48-85d2-5060a8f55eec] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:42:10.600764 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-66b25c79-a148-48cb-8c91-f45284278987 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:42:10.601263 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-66b25c79-a148-48cb-8c91-f45284278987 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:42:10.602315 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-66b25c79-a148-48cb-8c91-f45284278987 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:42:10.603063 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-66b25c79-a148-48cb-8c91-f45284278987 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:42:10.693423 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-66b25c79-a148-48cb-8c91-f45284278987 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:42:10.695147 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-66b25c79-a148-48cb-8c91-f45284278987 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:42:10.695803 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.objects.instance [None req-66b25c79-a148-48cb-8c91-f45284278987 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lazy-loading 'fault' on Instance uuid 2733931f-f68e-4f48-85d2-5060a8f55eec {{(pid=123386) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 21 09:42:10.718347 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-8623e5d9-c58c-4add-9e7b-1011829c46cd tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:42:10.719571 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-8623e5d9-c58c-4add-9e7b-1011829c46cd tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] [instance: e3dd8a17-5a2f-4f39-a110-208165e07110] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:42:10.732274 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-8623e5d9-c58c-4add-9e7b-1011829c46cd tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:42:10.733845 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-8623e5d9-c58c-4add-9e7b-1011829c46cd tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:42:10.736040 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-8623e5d9-c58c-4add-9e7b-1011829c46cd tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:42:10.737269 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-8623e5d9-c58c-4add-9e7b-1011829c46cd tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:42:10.822805 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-66b25c79-a148-48cb-8c91-f45284278987 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d53a7fa2cb5498aa916817b82dba77e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515ded26ca114fbf9c6e920362aec64c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:42:10.848186 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-66b25c79-a148-48cb-8c91-f45284278987 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] 10.222.0.45 "GET /compute/v2.1/servers/2733931f-f68e-4f48-85d2-5060a8f55eec" status: 200 len: 1184 microversion: 2.1 time: 0.260459 Jan 21 09:42:10.851311 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 486/970] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:42:10 2022] GET /compute/v2.1/servers/2733931f-f68e-4f48-85d2-5060a8f55eec => generated 1184 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:42:11.025792 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-90d8dfbf-260e-4350-a020-d971cc72d7bc tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:42:11.027385 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-90d8dfbf-260e-4350-a020-d971cc72d7bc tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] [instance: f4a4e6b7-47b1-4de2-8677-4f8e3eb056c2] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:42:11.055475 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-90d8dfbf-260e-4350-a020-d971cc72d7bc tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:42:11.056848 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-90d8dfbf-260e-4350-a020-d971cc72d7bc tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:42:11.058732 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-90d8dfbf-260e-4350-a020-d971cc72d7bc tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:42:11.059896 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-90d8dfbf-260e-4350-a020-d971cc72d7bc tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:42:11.115095 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-8623e5d9-c58c-4add-9e7b-1011829c46cd tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:42:11.138162 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-8623e5d9-c58c-4add-9e7b-1011829c46cd tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:42:11.142743 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-8623e5d9-c58c-4add-9e7b-1011829c46cd tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:42:11.146894 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-8623e5d9-c58c-4add-9e7b-1011829c46cd tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "GET /compute/v2.1/servers/e3dd8a17-5a2f-4f39-a110-208165e07110" status: 200 len: 1740 microversion: 2.20 time: 0.431783 Jan 21 09:42:11.150273 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 485/971] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jan 21 09:42:10 2022] GET /compute/v2.1/servers/e3dd8a17-5a2f-4f39-a110-208165e07110 => generated 1740 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 21 09:42:11.175047 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-90d8dfbf-260e-4350-a020-d971cc72d7bc tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aed8f68a416468cb303ae6c59a2203c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ac0334d1e14c29aa6222d547c64b00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:42:11.192548 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-90d8dfbf-260e-4350-a020-d971cc72d7bc tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] 10.222.0.45 "GET /compute/v2.1/servers/f4a4e6b7-47b1-4de2-8677-4f8e3eb056c2" status: 200 len: 1204 microversion: 2.1 time: 0.172389 Jan 21 09:42:11.205194 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 487/972] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:42:11 2022] GET /compute/v2.1/servers/f4a4e6b7-47b1-4de2-8677-4f8e3eb056c2 => generated 1204 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:42:11.879838 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-037d1c31-6684-43ef-834c-bc74c6e87df8 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:42:11.880737 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-037d1c31-6684-43ef-834c-bc74c6e87df8 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] [instance: 2733931f-f68e-4f48-85d2-5060a8f55eec] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:42:11.888836 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-037d1c31-6684-43ef-834c-bc74c6e87df8 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:42:11.889639 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-037d1c31-6684-43ef-834c-bc74c6e87df8 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:42:11.891216 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-037d1c31-6684-43ef-834c-bc74c6e87df8 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:42:11.892010 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-037d1c31-6684-43ef-834c-bc74c6e87df8 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:42:11.916826 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.wsgi [None req-037d1c31-6684-43ef-834c-bc74c6e87df8 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] HTTP exception thrown: Instance 2733931f-f68e-4f48-85d2-5060a8f55eec could not be found. Jan 21 09:42:11.918170 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-037d1c31-6684-43ef-834c-bc74c6e87df8 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Returning 404 to user: Instance 2733931f-f68e-4f48-85d2-5060a8f55eec could not be found. {{(pid=123387) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 21 09:42:11.919058 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-037d1c31-6684-43ef-834c-bc74c6e87df8 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] 10.222.0.45 "GET /compute/v2.1/servers/2733931f-f68e-4f48-85d2-5060a8f55eec" status: 404 len: 111 microversion: 2.1 time: 0.044264 Jan 21 09:42:11.919808 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 486/973] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:42:11 2022] GET /compute/v2.1/servers/2733931f-f68e-4f48-85d2-5060a8f55eec => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 21 09:42:12.105926 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-5ef43b62-adb7-46af-85da-bd6dc88b8d43 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-914953945", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-772796190", "security_groups": [{"name": "tempest-secgroup-smoke-159313003"}], "block_device_mapping_v2": [{"uuid": "dcc10ad4-b0a3-4923-8876-379fa078743e", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "858c4f17-92ac-4cda-9750-b98e2d3705f8"}]}} {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:42:12.172105 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-018ef29b-05d3-4ddb-a0c3-ec0bde1e0367 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:42:12.176352 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-018ef29b-05d3-4ddb-a0c3-ec0bde1e0367 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] [instance: e3dd8a17-5a2f-4f39-a110-208165e07110] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:42:12.205226 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-018ef29b-05d3-4ddb-a0c3-ec0bde1e0367 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:42:12.205226 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-018ef29b-05d3-4ddb-a0c3-ec0bde1e0367 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:42:12.205226 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-018ef29b-05d3-4ddb-a0c3-ec0bde1e0367 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:42:12.205226 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-018ef29b-05d3-4ddb-a0c3-ec0bde1e0367 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:42:12.462443 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.network.neutron [None req-5ef43b62-adb7-46af-85da-bd6dc88b8d43 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] validate_networks() for [('858c4f17-92ac-4cda-9750-b98e2d3705f8', None, None, None, None, None)] {{(pid=123386) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 21 09:42:12.698423 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-018ef29b-05d3-4ddb-a0c3-ec0bde1e0367 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:42:12.711695 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-018ef29b-05d3-4ddb-a0c3-ec0bde1e0367 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:42:12.715505 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-018ef29b-05d3-4ddb-a0c3-ec0bde1e0367 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:42:12.717703 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-018ef29b-05d3-4ddb-a0c3-ec0bde1e0367 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "GET /compute/v2.1/servers/e3dd8a17-5a2f-4f39-a110-208165e07110" status: 200 len: 1740 microversion: 2.20 time: 0.552692 Jan 21 09:42:12.718714 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 487/974] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jan 21 09:42:12 2022] GET /compute/v2.1/servers/e3dd8a17-5a2f-4f39-a110-208165e07110 => generated 1740 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 21 09:42:12.728411 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-c9b003c9-d1da-4d2b-a6c6-c5cb9009a0e4 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:42:12.730036 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-c9b003c9-d1da-4d2b-a6c6-c5cb9009a0e4 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] [instance: f4a4e6b7-47b1-4de2-8677-4f8e3eb056c2] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:42:12.741747 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-c9b003c9-d1da-4d2b-a6c6-c5cb9009a0e4 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:42:12.742456 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-c9b003c9-d1da-4d2b-a6c6-c5cb9009a0e4 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:42:12.744115 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-c9b003c9-d1da-4d2b-a6c6-c5cb9009a0e4 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:42:12.745112 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-c9b003c9-d1da-4d2b-a6c6-c5cb9009a0e4 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:42:13.191454 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-c9b003c9-d1da-4d2b-a6c6-c5cb9009a0e4 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aed8f68a416468cb303ae6c59a2203c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ac0334d1e14c29aa6222d547c64b00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:42:13.201510 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-c9b003c9-d1da-4d2b-a6c6-c5cb9009a0e4 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] 10.222.0.45 "GET /compute/v2.1/servers/f4a4e6b7-47b1-4de2-8677-4f8e3eb056c2" status: 200 len: 1259 microversion: 2.1 time: 0.481314 Jan 21 09:42:13.202425 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 488/975] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:42:12 2022] GET /compute/v2.1/servers/f4a4e6b7-47b1-4de2-8677-4f8e3eb056c2 => generated 1259 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:42:13.268125 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [req-552cb6d7-cb40-44ae-b000-3b7184bf63a3 req-70532d97-0053-4c20-9531-07ec1036cf0b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f4a4e6b7-47b1-4de2-8677-4f8e3eb056c2", "tag": "0e43678c-54de-414e-81b5-5773897a97f4"}]} {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:42:13.270415 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 21 09:42:13.270415 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: warnings.warn(msg) Jan 21 09:42:13.278876 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [req-552cb6d7-cb40-44ae-b000-3b7184bf63a3 req-70532d97-0053-4c20-9531-07ec1036cf0b service nova] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:42:13.279355 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [req-552cb6d7-cb40-44ae-b000-3b7184bf63a3 req-70532d97-0053-4c20-9531-07ec1036cf0b service nova] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:42:13.298780 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.compute.server_external_events [req-552cb6d7-cb40-44ae-b000-3b7184bf63a3 req-70532d97-0053-4c20-9531-07ec1036cf0b service nova] Creating event network-changed:0e43678c-54de-414e-81b5-5773897a97f4 for instance f4a4e6b7-47b1-4de2-8677-4f8e3eb056c2 on hv-cinder-80403 Jan 21 09:42:13.306055 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [req-552cb6d7-cb40-44ae-b000-3b7184bf63a3 req-70532d97-0053-4c20-9531-07ec1036cf0b service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043025 Jan 21 09:42:13.313742 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 489/976] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Jan 21 09:42:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 09:42:13.657554 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.virt.hardware [None req-5ef43b62-adb7-46af-85da-bd6dc88b8d43 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Flavor limits 0:0:0 {{(pid=123386) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 21 09:42:13.658781 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.virt.hardware [None req-5ef43b62-adb7-46af-85da-bd6dc88b8d43 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Image limits 0:0:0 {{(pid=123386) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 21 09:42:13.659212 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.virt.hardware [None req-5ef43b62-adb7-46af-85da-bd6dc88b8d43 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Flavor pref 0:0:0 {{(pid=123386) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 21 09:42:13.659625 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.virt.hardware [None req-5ef43b62-adb7-46af-85da-bd6dc88b8d43 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Image pref 0:0:0 {{(pid=123386) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 21 09:42:13.660124 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.virt.hardware [None req-5ef43b62-adb7-46af-85da-bd6dc88b8d43 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123386) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 21 09:42:13.672563 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-5ef43b62-adb7-46af-85da-bd6dc88b8d43 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:42:13.673702 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-5ef43b62-adb7-46af-85da-bd6dc88b8d43 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:42:13.674519 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-5ef43b62-adb7-46af-85da-bd6dc88b8d43 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:42:13.675034 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-5ef43b62-adb7-46af-85da-bd6dc88b8d43 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:42:13.693352 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.quota [None req-5ef43b62-adb7-46af-85da-bd6dc88b8d43 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Getting quotas for project 515ded26ca114fbf9c6e920362aec64c. Resources: {'cores', 'instances', 'ram'} {{(pid=123386) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 21 09:42:13.698016 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.quota [None req-5ef43b62-adb7-46af-85da-bd6dc88b8d43 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Getting quotas for user 3d53a7fa2cb5498aa916817b82dba77e and project 515ded26ca114fbf9c6e920362aec64c. Resources: {'cores', 'instances', 'ram'} {{(pid=123386) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 21 09:42:13.754631 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-0c0f2974-c2ef-4a0e-84e3-f9cc2ebfb94b tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:42:13.755843 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-0c0f2974-c2ef-4a0e-84e3-f9cc2ebfb94b tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] [instance: e3dd8a17-5a2f-4f39-a110-208165e07110] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:42:13.768331 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-0c0f2974-c2ef-4a0e-84e3-f9cc2ebfb94b tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:42:13.768748 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-5ef43b62-adb7-46af-85da-bd6dc88b8d43 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Going to run 1 instances... {{(pid=123386) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 21 09:42:13.768973 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-0c0f2974-c2ef-4a0e-84e3-f9cc2ebfb94b tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:42:13.770264 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-0c0f2974-c2ef-4a0e-84e3-f9cc2ebfb94b tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:42:13.770642 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-5ef43b62-adb7-46af-85da-bd6dc88b8d43 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] [instance: ef1ba7db-0bbf-44d8-ab58-f85d9194ecd6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='dcc10ad4-b0a3-4923-8876-379fa078743e',volume_size=None,volume_type=None)] {{(pid=123386) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 21 09:42:13.771204 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-0c0f2974-c2ef-4a0e-84e3-f9cc2ebfb94b tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:42:14.078366 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-0c0f2974-c2ef-4a0e-84e3-f9cc2ebfb94b tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:42:14.087475 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-0c0f2974-c2ef-4a0e-84e3-f9cc2ebfb94b tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:42:14.088986 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-0c0f2974-c2ef-4a0e-84e3-f9cc2ebfb94b tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:42:14.090247 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-0c0f2974-c2ef-4a0e-84e3-f9cc2ebfb94b tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "GET /compute/v2.1/servers/e3dd8a17-5a2f-4f39-a110-208165e07110" status: 200 len: 1722 microversion: 2.20 time: 0.344660 Jan 21 09:42:14.090875 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 490/977] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jan 21 09:42:13 2022] GET /compute/v2.1/servers/e3dd8a17-5a2f-4f39-a110-208165e07110 => generated 1722 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 21 09:42:14.225494 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-e64a807c-4d7e-4bc0-9018-ec728d3b68f2 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:42:14.227080 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-e64a807c-4d7e-4bc0-9018-ec728d3b68f2 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] [instance: f4a4e6b7-47b1-4de2-8677-4f8e3eb056c2] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:42:14.238444 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-e64a807c-4d7e-4bc0-9018-ec728d3b68f2 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:42:14.239464 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-e64a807c-4d7e-4bc0-9018-ec728d3b68f2 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:42:14.240958 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-e64a807c-4d7e-4bc0-9018-ec728d3b68f2 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:42:14.242186 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-e64a807c-4d7e-4bc0-9018-ec728d3b68f2 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:42:14.347221 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-5ef43b62-adb7-46af-85da-bd6dc88b8d43 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.245366 Jan 21 09:42:14.348787 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 488/978] 10.222.0.45 () {60 vars in 1146 bytes} [Fri Jan 21 09:42:12 2022] POST /compute/v2.1/servers => generated 405 bytes in 2248 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 21 09:42:14.365287 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-265ca554-37f5-467c-96aa-d61040b8edcd tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:42:14.368630 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-265ca554-37f5-467c-96aa-d61040b8edcd tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] [instance: ef1ba7db-0bbf-44d8-ab58-f85d9194ecd6] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:42:14.500770 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-265ca554-37f5-467c-96aa-d61040b8edcd tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d53a7fa2cb5498aa916817b82dba77e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515ded26ca114fbf9c6e920362aec64c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:42:14.516475 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-265ca554-37f5-467c-96aa-d61040b8edcd tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] 10.222.0.45 "GET /compute/v2.1/servers/ef1ba7db-0bbf-44d8-ab58-f85d9194ecd6" status: 200 len: 1093 microversion: 2.1 time: 0.157804 Jan 21 09:42:14.518481 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 489/979] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:42:14 2022] GET /compute/v2.1/servers/ef1ba7db-0bbf-44d8-ab58-f85d9194ecd6 => generated 1093 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:42:14.528505 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-e6673a3f-9288-4243-a468-1df28800bd50 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:42:14.529826 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-e6673a3f-9288-4243-a468-1df28800bd50 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] [instance: 9c18953a-7af3-4d71-97ad-05eda7e34a73] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:42:14.541574 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-e6673a3f-9288-4243-a468-1df28800bd50 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:42:14.542353 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-e6673a3f-9288-4243-a468-1df28800bd50 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:42:14.543757 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-e6673a3f-9288-4243-a468-1df28800bd50 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:42:14.544559 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-e6673a3f-9288-4243-a468-1df28800bd50 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:42:14.585364 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-e64a807c-4d7e-4bc0-9018-ec728d3b68f2 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aed8f68a416468cb303ae6c59a2203c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ac0334d1e14c29aa6222d547c64b00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:42:14.599028 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-e64a807c-4d7e-4bc0-9018-ec728d3b68f2 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] 10.222.0.45 "GET /compute/v2.1/servers/f4a4e6b7-47b1-4de2-8677-4f8e3eb056c2" status: 200 len: 1259 microversion: 2.1 time: 0.381201 Jan 21 09:42:14.600681 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 491/980] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:42:14 2022] GET /compute/v2.1/servers/f4a4e6b7-47b1-4de2-8677-4f8e3eb056c2 => generated 1259 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:42:14.691042 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.objects.instance [None req-e6673a3f-9288-4243-a468-1df28800bd50 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lazy-loading 'services' on Instance uuid 9c18953a-7af3-4d71-97ad-05eda7e34a73 {{(pid=123386) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 21 09:42:15.118136 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-06c3fe42-8b93-4180-86ae-0c2dbf823eca tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:42:15.118753 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-06c3fe42-8b93-4180-86ae-0c2dbf823eca tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] [instance: e3dd8a17-5a2f-4f39-a110-208165e07110] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:42:15.125797 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-06c3fe42-8b93-4180-86ae-0c2dbf823eca tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:42:15.126242 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-06c3fe42-8b93-4180-86ae-0c2dbf823eca tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:42:15.127785 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-06c3fe42-8b93-4180-86ae-0c2dbf823eca tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:42:15.128473 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-06c3fe42-8b93-4180-86ae-0c2dbf823eca tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:42:15.187253 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-e6673a3f-9288-4243-a468-1df28800bd50 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] 10.222.0.45 "DELETE /compute/v2.1/servers/9c18953a-7af3-4d71-97ad-05eda7e34a73/os-volume_attachments/1e5587e1-adfd-485f-b9b8-394104580c61" status: 202 len: 0 microversion: 2.1 time: 0.666406 Jan 21 09:42:15.187853 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 490/981] 10.222.0.45 () {58 vars in 1415 bytes} [Fri Jan 21 09:42:14 2022] DELETE /compute/v2.1/servers/9c18953a-7af3-4d71-97ad-05eda7e34a73/os-volume_attachments/1e5587e1-adfd-485f-b9b8-394104580c61 => generated 0 bytes in 669 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 21 09:42:15.289321 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-06c3fe42-8b93-4180-86ae-0c2dbf823eca tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:42:15.297314 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-06c3fe42-8b93-4180-86ae-0c2dbf823eca tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:42:15.302097 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-06c3fe42-8b93-4180-86ae-0c2dbf823eca tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:42:15.302097 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-06c3fe42-8b93-4180-86ae-0c2dbf823eca tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "GET /compute/v2.1/servers/e3dd8a17-5a2f-4f39-a110-208165e07110" status: 200 len: 1722 microversion: 2.20 time: 0.186648 Jan 21 09:42:15.302097 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 492/982] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jan 21 09:42:15 2022] GET /compute/v2.1/servers/e3dd8a17-5a2f-4f39-a110-208165e07110 => generated 1722 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 21 09:42:15.536682 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-bab67246-45d1-4c04-87ba-2bc220b01dd8 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:42:15.536682 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-bab67246-45d1-4c04-87ba-2bc220b01dd8 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] [instance: ef1ba7db-0bbf-44d8-ab58-f85d9194ecd6] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:42:15.617623 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-bab67246-45d1-4c04-87ba-2bc220b01dd8 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d53a7fa2cb5498aa916817b82dba77e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515ded26ca114fbf9c6e920362aec64c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:42:15.618843 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-acf5ff18-0293-4e84-803b-f3075a11503d tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:42:15.619466 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-acf5ff18-0293-4e84-803b-f3075a11503d tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] [instance: f4a4e6b7-47b1-4de2-8677-4f8e3eb056c2] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:42:15.625106 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-bab67246-45d1-4c04-87ba-2bc220b01dd8 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] 10.222.0.45 "GET /compute/v2.1/servers/ef1ba7db-0bbf-44d8-ab58-f85d9194ecd6" status: 200 len: 1093 microversion: 2.1 time: 0.094711 Jan 21 09:42:15.625640 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-acf5ff18-0293-4e84-803b-f3075a11503d tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:42:15.626092 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-acf5ff18-0293-4e84-803b-f3075a11503d tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:42:15.627083 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 491/983] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:42:15 2022] GET /compute/v2.1/servers/ef1ba7db-0bbf-44d8-ab58-f85d9194ecd6 => generated 1093 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:42:15.627612 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-acf5ff18-0293-4e84-803b-f3075a11503d tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:42:15.628075 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-acf5ff18-0293-4e84-803b-f3075a11503d tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:42:15.803200 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-acf5ff18-0293-4e84-803b-f3075a11503d tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aed8f68a416468cb303ae6c59a2203c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ac0334d1e14c29aa6222d547c64b00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:42:15.821013 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-acf5ff18-0293-4e84-803b-f3075a11503d tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] 10.222.0.45 "GET /compute/v2.1/servers/f4a4e6b7-47b1-4de2-8677-4f8e3eb056c2" status: 200 len: 1259 microversion: 2.1 time: 0.205755 Jan 21 09:42:15.822145 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 493/984] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:42:15 2022] GET /compute/v2.1/servers/f4a4e6b7-47b1-4de2-8677-4f8e3eb056c2 => generated 1259 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:42:15.872617 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [req-0924d74d-ed7c-4bc5-89d3-4917e72fdfb6 req-fc7bd311-eabc-49ae-839d-301c06423e40 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3dd8a17-5a2f-4f39-a110-208165e07110", "name": "network-vif-unplugged", "status": "completed", "tag": "248e29e3-d311-4074-bc03-c8c881428352"}]} {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:42:15.876268 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 21 09:42:15.876268 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: warnings.warn(msg) Jan 21 09:42:15.887545 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [req-0924d74d-ed7c-4bc5-89d3-4917e72fdfb6 req-fc7bd311-eabc-49ae-839d-301c06423e40 service nova] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:42:15.888387 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [req-0924d74d-ed7c-4bc5-89d3-4917e72fdfb6 req-fc7bd311-eabc-49ae-839d-301c06423e40 service nova] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:42:15.905120 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.compute.server_external_events [req-0924d74d-ed7c-4bc5-89d3-4917e72fdfb6 req-fc7bd311-eabc-49ae-839d-301c06423e40 service nova] Creating event network-vif-unplugged:248e29e3-d311-4074-bc03-c8c881428352 for instance e3dd8a17-5a2f-4f39-a110-208165e07110 on hv-cinder-80403 Jan 21 09:42:15.911937 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [req-0924d74d-ed7c-4bc5-89d3-4917e72fdfb6 req-fc7bd311-eabc-49ae-839d-301c06423e40 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.051310 Jan 21 09:42:15.912656 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 492/985] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Jan 21 09:42:15 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 21 09:42:16.320352 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-4f98e298-6337-47bf-85f1-6e7657746bb5 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:42:16.321220 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-4f98e298-6337-47bf-85f1-6e7657746bb5 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] [instance: e3dd8a17-5a2f-4f39-a110-208165e07110] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:42:16.328753 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-4f98e298-6337-47bf-85f1-6e7657746bb5 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:42:16.329264 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-4f98e298-6337-47bf-85f1-6e7657746bb5 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:42:16.330864 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-4f98e298-6337-47bf-85f1-6e7657746bb5 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:42:16.331320 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-4f98e298-6337-47bf-85f1-6e7657746bb5 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:42:16.525685 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-4f98e298-6337-47bf-85f1-6e7657746bb5 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:42:16.539776 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-4f98e298-6337-47bf-85f1-6e7657746bb5 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:42:16.543188 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-4f98e298-6337-47bf-85f1-6e7657746bb5 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:42:16.545391 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-4f98e298-6337-47bf-85f1-6e7657746bb5 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "GET /compute/v2.1/servers/e3dd8a17-5a2f-4f39-a110-208165e07110" status: 200 len: 1725 microversion: 2.20 time: 0.228494 Jan 21 09:42:16.546480 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 494/986] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jan 21 09:42:16 2022] GET /compute/v2.1/servers/e3dd8a17-5a2f-4f39-a110-208165e07110 => generated 1725 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 21 09:42:16.576175 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-bae0c12d-42e1-4184-81d2-56622ddcfba3 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "099a9c66-a410-4f31-8035-ca69238ccf5b"}} {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:42:16.577369 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-bae0c12d-42e1-4184-81d2-56622ddcfba3 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] [instance: e3dd8a17-5a2f-4f39-a110-208165e07110] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:42:16.589193 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-bae0c12d-42e1-4184-81d2-56622ddcfba3 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:42:16.592129 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-bae0c12d-42e1-4184-81d2-56622ddcfba3 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:42:16.592129 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-bae0c12d-42e1-4184-81d2-56622ddcfba3 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:42:16.592129 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-bae0c12d-42e1-4184-81d2-56622ddcfba3 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:42:16.661620 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-3845c57d-f38c-4827-9a93-95310e4f2d9f tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:42:16.663189 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-3845c57d-f38c-4827-9a93-95310e4f2d9f tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] [instance: ef1ba7db-0bbf-44d8-ab58-f85d9194ecd6] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:42:16.676482 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-3845c57d-f38c-4827-9a93-95310e4f2d9f tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:42:16.677194 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-3845c57d-f38c-4827-9a93-95310e4f2d9f tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:42:16.683976 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-3845c57d-f38c-4827-9a93-95310e4f2d9f tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:42:16.683976 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-3845c57d-f38c-4827-9a93-95310e4f2d9f tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:42:16.768845 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-3845c57d-f38c-4827-9a93-95310e4f2d9f tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d53a7fa2cb5498aa916817b82dba77e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515ded26ca114fbf9c6e920362aec64c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:42:16.784320 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-3845c57d-f38c-4827-9a93-95310e4f2d9f tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] 10.222.0.45 "GET /compute/v2.1/servers/ef1ba7db-0bbf-44d8-ab58-f85d9194ecd6" status: 200 len: 1191 microversion: 2.1 time: 0.138829 Jan 21 09:42:16.784958 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 495/987] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:42:16 2022] GET /compute/v2.1/servers/ef1ba7db-0bbf-44d8-ab58-f85d9194ecd6 => generated 1191 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:42:16.849031 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-a7a3efb4-30a3-4818-87fe-f476da8df42e tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:42:16.849695 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-a7a3efb4-30a3-4818-87fe-f476da8df42e tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] [instance: f4a4e6b7-47b1-4de2-8677-4f8e3eb056c2] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:42:16.856291 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-a7a3efb4-30a3-4818-87fe-f476da8df42e tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:42:16.856744 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-a7a3efb4-30a3-4818-87fe-f476da8df42e tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:42:16.857601 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-a7a3efb4-30a3-4818-87fe-f476da8df42e tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:42:16.858060 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-a7a3efb4-30a3-4818-87fe-f476da8df42e tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:42:17.044807 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-a7a3efb4-30a3-4818-87fe-f476da8df42e tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aed8f68a416468cb303ae6c59a2203c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ac0334d1e14c29aa6222d547c64b00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:42:17.054242 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-a7a3efb4-30a3-4818-87fe-f476da8df42e tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] 10.222.0.45 "GET /compute/v2.1/servers/f4a4e6b7-47b1-4de2-8677-4f8e3eb056c2" status: 200 len: 1259 microversion: 2.1 time: 0.210530 Jan 21 09:42:17.054842 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 496/988] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:42:16 2022] GET /compute/v2.1/servers/f4a4e6b7-47b1-4de2-8677-4f8e3eb056c2 => generated 1259 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 09:42:17.367802 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-c2019d1f-a64a-480f-b627-89d4afb42da7 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:42:17.375059 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-c2019d1f-a64a-480f-b627-89d4afb42da7 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:42:17.375513 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-c2019d1f-a64a-480f-b627-89d4afb42da7 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:42:17.607500 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-c2019d1f-a64a-480f-b627-89d4afb42da7 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] [instance: 9c18953a-7af3-4d71-97ad-05eda7e34a73] Going to try to stop instance {{(pid=123387) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Jan 21 09:42:17.861756 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-c2019d1f-a64a-480f-b627-89d4afb42da7 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] 10.222.0.45 "POST /compute/v2.1/servers/9c18953a-7af3-4d71-97ad-05eda7e34a73/action" status: 202 len: 0 microversion: 2.1 time: 0.496736 Jan 21 09:42:17.863860 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 497/989] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Jan 21 09:42:17 2022] POST /compute/v2.1/servers/9c18953a-7af3-4d71-97ad-05eda7e34a73/action => generated 0 bytes in 501 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jan 21 09:42:17.875206 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-568b207f-117b-4482-885a-89e6a73d4fa1 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:42:17.878468 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-568b207f-117b-4482-885a-89e6a73d4fa1 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] [instance: ef1ba7db-0bbf-44d8-ab58-f85d9194ecd6] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:42:17.894859 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-568b207f-117b-4482-885a-89e6a73d4fa1 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:42:17.894859 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-568b207f-117b-4482-885a-89e6a73d4fa1 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:42:17.905445 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-568b207f-117b-4482-885a-89e6a73d4fa1 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:42:17.910451 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-568b207f-117b-4482-885a-89e6a73d4fa1 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:42:18.016041 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-bae0c12d-42e1-4184-81d2-56622ddcfba3 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "POST /compute/v2.1/servers/e3dd8a17-5a2f-4f39-a110-208165e07110/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.446879 Jan 21 09:42:18.017430 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 493/990] 10.222.0.45 () {62 vars in 1363 bytes} [Fri Jan 21 09:42:16 2022] POST /compute/v2.1/servers/e3dd8a17-5a2f-4f39-a110-208165e07110/os-volume_attachments => generated 188 bytes in 1450 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 21 09:42:18.031779 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-d91c3ca8-6255-4d4b-a17f-1c2ea9a431fc tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:42:18.034291 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-d91c3ca8-6255-4d4b-a17f-1c2ea9a431fc tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] [instance: 9c18953a-7af3-4d71-97ad-05eda7e34a73] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:42:18.060874 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-568b207f-117b-4482-885a-89e6a73d4fa1 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d53a7fa2cb5498aa916817b82dba77e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515ded26ca114fbf9c6e920362aec64c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:42:18.066169 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-d91c3ca8-6255-4d4b-a17f-1c2ea9a431fc tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:42:18.066644 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-d91c3ca8-6255-4d4b-a17f-1c2ea9a431fc tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:42:18.067501 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-d91c3ca8-6255-4d4b-a17f-1c2ea9a431fc tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:42:18.067945 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-d91c3ca8-6255-4d4b-a17f-1c2ea9a431fc tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:42:18.074731 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-568b207f-117b-4482-885a-89e6a73d4fa1 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] 10.222.0.45 "GET /compute/v2.1/servers/ef1ba7db-0bbf-44d8-ab58-f85d9194ecd6" status: 200 len: 1209 microversion: 2.1 time: 0.208327 Jan 21 09:42:18.075361 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 498/991] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:42:17 2022] GET /compute/v2.1/servers/ef1ba7db-0bbf-44d8-ab58-f85d9194ecd6 => generated 1209 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:42:18.081497 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-2b39c5b4-0793-46c5-9c09-3ce8978290da tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:42:18.082131 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-2b39c5b4-0793-46c5-9c09-3ce8978290da tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] [instance: f4a4e6b7-47b1-4de2-8677-4f8e3eb056c2] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:42:18.088765 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-2b39c5b4-0793-46c5-9c09-3ce8978290da tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:42:18.089239 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-2b39c5b4-0793-46c5-9c09-3ce8978290da tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:42:18.090424 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-2b39c5b4-0793-46c5-9c09-3ce8978290da tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:42:18.091147 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-2b39c5b4-0793-46c5-9c09-3ce8978290da tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:42:18.503644 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-d91c3ca8-6255-4d4b-a17f-1c2ea9a431fc tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '590e721135c84df5946147ac7e944fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2322cb784615409bb15a6f49522d3b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:42:18.512195 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-d91c3ca8-6255-4d4b-a17f-1c2ea9a431fc tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] 10.222.0.45 "GET /compute/v2.1/servers/9c18953a-7af3-4d71-97ad-05eda7e34a73" status: 200 len: 1680 microversion: 2.1 time: 0.492607 Jan 21 09:42:18.513366 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 494/992] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:42:18 2022] GET /compute/v2.1/servers/9c18953a-7af3-4d71-97ad-05eda7e34a73 => generated 1680 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:42:18.518223 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-2b39c5b4-0793-46c5-9c09-3ce8978290da tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aed8f68a416468cb303ae6c59a2203c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ac0334d1e14c29aa6222d547c64b00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:42:18.519814 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-d29546d5-b479-436a-98fa-58e28f9d8a2a tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:42:18.519814 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-d29546d5-b479-436a-98fa-58e28f9d8a2a tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] [instance: e3dd8a17-5a2f-4f39-a110-208165e07110] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:42:18.525589 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-d29546d5-b479-436a-98fa-58e28f9d8a2a tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:42:18.526135 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-d29546d5-b479-436a-98fa-58e28f9d8a2a tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:42:18.527033 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-d29546d5-b479-436a-98fa-58e28f9d8a2a tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:42:18.527535 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-d29546d5-b479-436a-98fa-58e28f9d8a2a tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:42:18.534127 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-2b39c5b4-0793-46c5-9c09-3ce8978290da tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] 10.222.0.45 "GET /compute/v2.1/servers/f4a4e6b7-47b1-4de2-8677-4f8e3eb056c2" status: 200 len: 1259 microversion: 2.1 time: 0.456388 Jan 21 09:42:18.535236 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 499/993] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:42:18 2022] GET /compute/v2.1/servers/f4a4e6b7-47b1-4de2-8677-4f8e3eb056c2 => generated 1259 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:42:19.101986 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-c950484d-982e-4169-9dc4-0b9ddeecaeea tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:42:19.102861 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-c950484d-982e-4169-9dc4-0b9ddeecaeea tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] [instance: ef1ba7db-0bbf-44d8-ab58-f85d9194ecd6] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:42:19.115601 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-c950484d-982e-4169-9dc4-0b9ddeecaeea tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:42:19.116537 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-c950484d-982e-4169-9dc4-0b9ddeecaeea tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:42:19.117740 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-c950484d-982e-4169-9dc4-0b9ddeecaeea tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:42:19.118827 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-c950484d-982e-4169-9dc4-0b9ddeecaeea tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:42:19.215527 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-d29546d5-b479-436a-98fa-58e28f9d8a2a tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "DELETE /compute/v2.1/servers/e3dd8a17-5a2f-4f39-a110-208165e07110/os-volume_attachments/099a9c66-a410-4f31-8035-ca69238ccf5b" status: 202 len: 0 microversion: 2.20 time: 0.701436 Jan 21 09:42:19.216617 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 495/994] 10.222.0.45 () {60 vars in 1456 bytes} [Fri Jan 21 09:42:18 2022] DELETE /compute/v2.1/servers/e3dd8a17-5a2f-4f39-a110-208165e07110/os-volume_attachments/099a9c66-a410-4f31-8035-ca69238ccf5b => generated 0 bytes in 703 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jan 21 09:42:19.309731 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-7d74958c-b508-45b4-884d-fbe87767d028 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:42:19.311011 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-7d74958c-b508-45b4-884d-fbe87767d028 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] [instance: e3dd8a17-5a2f-4f39-a110-208165e07110] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:42:19.320440 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-7d74958c-b508-45b4-884d-fbe87767d028 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:42:19.321211 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-7d74958c-b508-45b4-884d-fbe87767d028 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:42:19.327412 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-7d74958c-b508-45b4-884d-fbe87767d028 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:42:19.327412 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-7d74958c-b508-45b4-884d-fbe87767d028 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:42:19.488935 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-c950484d-982e-4169-9dc4-0b9ddeecaeea tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d53a7fa2cb5498aa916817b82dba77e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515ded26ca114fbf9c6e920362aec64c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:42:19.500840 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-c950484d-982e-4169-9dc4-0b9ddeecaeea tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] 10.222.0.45 "GET /compute/v2.1/servers/ef1ba7db-0bbf-44d8-ab58-f85d9194ecd6" status: 200 len: 1276 microversion: 2.1 time: 0.403581 Jan 21 09:42:19.502277 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 500/995] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:42:19 2022] GET /compute/v2.1/servers/ef1ba7db-0bbf-44d8-ab58-f85d9194ecd6 => generated 1276 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 09:42:19.543172 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-1f29def1-66b4-47e3-b5f6-5cd5d63b9dce tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:42:19.543172 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-1f29def1-66b4-47e3-b5f6-5cd5d63b9dce tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] [instance: 9c18953a-7af3-4d71-97ad-05eda7e34a73] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:42:19.548228 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-1f29def1-66b4-47e3-b5f6-5cd5d63b9dce tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:42:19.550813 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-1f29def1-66b4-47e3-b5f6-5cd5d63b9dce tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:42:19.551461 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-1f29def1-66b4-47e3-b5f6-5cd5d63b9dce tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:42:19.551916 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-1f29def1-66b4-47e3-b5f6-5cd5d63b9dce tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:42:19.688170 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-7d74958c-b508-45b4-884d-fbe87767d028 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "POST /compute/v2.1/servers/e3dd8a17-5a2f-4f39-a110-208165e07110/action" status: 202 len: 0 microversion: 2.20 time: 0.384166 Jan 21 09:42:19.693789 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 496/996] 10.222.0.45 () {62 vars in 1318 bytes} [Fri Jan 21 09:42:19 2022] POST /compute/v2.1/servers/e3dd8a17-5a2f-4f39-a110-208165e07110/action => generated 0 bytes in 387 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jan 21 09:42:19.701270 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-d3f2e843-cb4a-4fc9-a810-11e600537e93 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:42:19.702447 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-d3f2e843-cb4a-4fc9-a810-11e600537e93 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] [instance: f4a4e6b7-47b1-4de2-8677-4f8e3eb056c2] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:42:19.716269 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-d3f2e843-cb4a-4fc9-a810-11e600537e93 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:42:19.717093 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-d3f2e843-cb4a-4fc9-a810-11e600537e93 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:42:19.718617 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-d3f2e843-cb4a-4fc9-a810-11e600537e93 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:42:19.719421 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-d3f2e843-cb4a-4fc9-a810-11e600537e93 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:42:19.966053 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-1f29def1-66b4-47e3-b5f6-5cd5d63b9dce tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '590e721135c84df5946147ac7e944fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2322cb784615409bb15a6f49522d3b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:42:19.978944 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-1f29def1-66b4-47e3-b5f6-5cd5d63b9dce tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] 10.222.0.45 "GET /compute/v2.1/servers/9c18953a-7af3-4d71-97ad-05eda7e34a73" status: 200 len: 1680 microversion: 2.1 time: 0.442134 Jan 21 09:42:19.979545 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 501/997] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:42:19 2022] GET /compute/v2.1/servers/9c18953a-7af3-4d71-97ad-05eda7e34a73 => generated 1680 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 09:42:19.999093 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-45b471ce-b9b2-435c-8826-6705edb30fe3 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:42:20.006108 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-45b471ce-b9b2-435c-8826-6705edb30fe3 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] [instance: e3dd8a17-5a2f-4f39-a110-208165e07110] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:42:20.008462 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-45b471ce-b9b2-435c-8826-6705edb30fe3 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:42:20.008904 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-45b471ce-b9b2-435c-8826-6705edb30fe3 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:42:20.009809 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-45b471ce-b9b2-435c-8826-6705edb30fe3 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:42:20.010263 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-45b471ce-b9b2-435c-8826-6705edb30fe3 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:42:20.130115 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-d3f2e843-cb4a-4fc9-a810-11e600537e93 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aed8f68a416468cb303ae6c59a2203c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ac0334d1e14c29aa6222d547c64b00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:42:20.141678 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-d3f2e843-cb4a-4fc9-a810-11e600537e93 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] 10.222.0.45 "GET /compute/v2.1/servers/f4a4e6b7-47b1-4de2-8677-4f8e3eb056c2" status: 200 len: 1259 microversion: 2.1 time: 0.450227 Jan 21 09:42:20.143278 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 497/998] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:42:19 2022] GET /compute/v2.1/servers/f4a4e6b7-47b1-4de2-8677-4f8e3eb056c2 => generated 1259 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:42:20.285999 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-45b471ce-b9b2-435c-8826-6705edb30fe3 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:42:20.296343 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-45b471ce-b9b2-435c-8826-6705edb30fe3 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:42:20.298158 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-45b471ce-b9b2-435c-8826-6705edb30fe3 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:42:20.299424 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-45b471ce-b9b2-435c-8826-6705edb30fe3 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "GET /compute/v2.1/servers/e3dd8a17-5a2f-4f39-a110-208165e07110" status: 200 len: 1673 microversion: 2.20 time: 0.318708 Jan 21 09:42:20.299989 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 502/999] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jan 21 09:42:19 2022] GET /compute/v2.1/servers/e3dd8a17-5a2f-4f39-a110-208165e07110 => generated 1673 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 21 09:42:20.532499 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-dcd8dee8-0198-40c7-a2ad-e22b2a4648c8 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:42:20.534140 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-dcd8dee8-0198-40c7-a2ad-e22b2a4648c8 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] [instance: ef1ba7db-0bbf-44d8-ab58-f85d9194ecd6] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:42:20.543965 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-dcd8dee8-0198-40c7-a2ad-e22b2a4648c8 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:42:20.544585 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-dcd8dee8-0198-40c7-a2ad-e22b2a4648c8 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:42:20.545718 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-dcd8dee8-0198-40c7-a2ad-e22b2a4648c8 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:42:20.546429 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-dcd8dee8-0198-40c7-a2ad-e22b2a4648c8 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:42:20.797265 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-dcd8dee8-0198-40c7-a2ad-e22b2a4648c8 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d53a7fa2cb5498aa916817b82dba77e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515ded26ca114fbf9c6e920362aec64c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:42:20.806355 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-dcd8dee8-0198-40c7-a2ad-e22b2a4648c8 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] 10.222.0.45 "GET /compute/v2.1/servers/ef1ba7db-0bbf-44d8-ab58-f85d9194ecd6" status: 200 len: 1264 microversion: 2.1 time: 0.279277 Jan 21 09:42:20.807339 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 498/1000] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:42:20 2022] GET /compute/v2.1/servers/ef1ba7db-0bbf-44d8-ab58-f85d9194ecd6 => generated 1264 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:42:20.849713 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [req-f1b79533-ed64-4071-a0c2-91a117e7d001 req-8b389b97-28b7-4f2c-bf19-19932a69e23c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ef1ba7db-0bbf-44d8-ab58-f85d9194ecd6", "tag": "23ca9b58-bb47-447e-9704-d2768396690b"}]} {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:42:20.853214 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 21 09:42:20.853214 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: warnings.warn(msg) Jan 21 09:42:20.860102 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [req-f1b79533-ed64-4071-a0c2-91a117e7d001 req-8b389b97-28b7-4f2c-bf19-19932a69e23c service nova] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:42:20.860531 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [req-f1b79533-ed64-4071-a0c2-91a117e7d001 req-8b389b97-28b7-4f2c-bf19-19932a69e23c service nova] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:42:20.876174 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.compute.server_external_events [req-f1b79533-ed64-4071-a0c2-91a117e7d001 req-8b389b97-28b7-4f2c-bf19-19932a69e23c service nova] Creating event network-changed:23ca9b58-bb47-447e-9704-d2768396690b for instance ef1ba7db-0bbf-44d8-ab58-f85d9194ecd6 on hv-cinder-80403 Jan 21 09:42:20.880144 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [req-f1b79533-ed64-4071-a0c2-91a117e7d001 req-8b389b97-28b7-4f2c-bf19-19932a69e23c service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035151 Jan 21 09:42:20.881480 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 503/1001] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Jan 21 09:42:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 09:42:21.002380 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-d2af8888-e963-465c-a18a-2869802ae91b tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:42:21.003312 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-d2af8888-e963-465c-a18a-2869802ae91b tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] [instance: 9c18953a-7af3-4d71-97ad-05eda7e34a73] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:42:21.010598 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-d2af8888-e963-465c-a18a-2869802ae91b tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:42:21.011051 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-d2af8888-e963-465c-a18a-2869802ae91b tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:42:21.011897 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-d2af8888-e963-465c-a18a-2869802ae91b tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:42:21.012336 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-d2af8888-e963-465c-a18a-2869802ae91b tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:42:21.166603 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-9b2eaef2-d365-4cf3-b43b-ce87a0ff7601 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:42:21.167691 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-9b2eaef2-d365-4cf3-b43b-ce87a0ff7601 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] [instance: f4a4e6b7-47b1-4de2-8677-4f8e3eb056c2] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:42:21.177842 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-9b2eaef2-d365-4cf3-b43b-ce87a0ff7601 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:42:21.178822 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-9b2eaef2-d365-4cf3-b43b-ce87a0ff7601 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:42:21.179878 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-9b2eaef2-d365-4cf3-b43b-ce87a0ff7601 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:42:21.180326 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-9b2eaef2-d365-4cf3-b43b-ce87a0ff7601 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:42:21.389797 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-d2af8888-e963-465c-a18a-2869802ae91b tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '590e721135c84df5946147ac7e944fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2322cb784615409bb15a6f49522d3b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:42:21.400206 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-d2af8888-e963-465c-a18a-2869802ae91b tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] 10.222.0.45 "GET /compute/v2.1/servers/9c18953a-7af3-4d71-97ad-05eda7e34a73" status: 200 len: 1680 microversion: 2.1 time: 0.404204 Jan 21 09:42:21.401358 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 499/1002] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:42:20 2022] GET /compute/v2.1/servers/9c18953a-7af3-4d71-97ad-05eda7e34a73 => generated 1680 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:42:21.406158 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-69e26b02-7bd8-4eda-9d38-182c29008050 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:42:21.407026 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-69e26b02-7bd8-4eda-9d38-182c29008050 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] [instance: e3dd8a17-5a2f-4f39-a110-208165e07110] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:42:21.415293 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-69e26b02-7bd8-4eda-9d38-182c29008050 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:42:21.416057 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-69e26b02-7bd8-4eda-9d38-182c29008050 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:42:21.417058 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-69e26b02-7bd8-4eda-9d38-182c29008050 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:42:21.417693 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-69e26b02-7bd8-4eda-9d38-182c29008050 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:42:21.569829 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-9b2eaef2-d365-4cf3-b43b-ce87a0ff7601 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aed8f68a416468cb303ae6c59a2203c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ac0334d1e14c29aa6222d547c64b00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:42:21.577944 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-9b2eaef2-d365-4cf3-b43b-ce87a0ff7601 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] 10.222.0.45 "GET /compute/v2.1/servers/f4a4e6b7-47b1-4de2-8677-4f8e3eb056c2" status: 200 len: 1259 microversion: 2.1 time: 0.420736 Jan 21 09:42:21.587722 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 504/1003] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:42:21 2022] GET /compute/v2.1/servers/f4a4e6b7-47b1-4de2-8677-4f8e3eb056c2 => generated 1259 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:42:21.756726 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-69e26b02-7bd8-4eda-9d38-182c29008050 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:42:21.766417 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-69e26b02-7bd8-4eda-9d38-182c29008050 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:42:21.769711 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-69e26b02-7bd8-4eda-9d38-182c29008050 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:42:21.770987 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-69e26b02-7bd8-4eda-9d38-182c29008050 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "GET /compute/v2.1/servers/e3dd8a17-5a2f-4f39-a110-208165e07110" status: 200 len: 1731 microversion: 2.20 time: 0.368416 Jan 21 09:42:21.771980 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 500/1004] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jan 21 09:42:21 2022] GET /compute/v2.1/servers/e3dd8a17-5a2f-4f39-a110-208165e07110 => generated 1731 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 21 09:42:21.831759 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-8529bbaf-3899-4936-a405-4adcedbb16f2 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:42:21.832783 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-8529bbaf-3899-4936-a405-4adcedbb16f2 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] [instance: ef1ba7db-0bbf-44d8-ab58-f85d9194ecd6] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:42:21.841344 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-8529bbaf-3899-4936-a405-4adcedbb16f2 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:42:21.842060 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-8529bbaf-3899-4936-a405-4adcedbb16f2 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:42:21.843359 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-8529bbaf-3899-4936-a405-4adcedbb16f2 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:42:21.844141 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-8529bbaf-3899-4936-a405-4adcedbb16f2 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:42:22.256570 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-8529bbaf-3899-4936-a405-4adcedbb16f2 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d53a7fa2cb5498aa916817b82dba77e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515ded26ca114fbf9c6e920362aec64c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:42:22.271082 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-8529bbaf-3899-4936-a405-4adcedbb16f2 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] 10.222.0.45 "GET /compute/v2.1/servers/ef1ba7db-0bbf-44d8-ab58-f85d9194ecd6" status: 200 len: 1264 microversion: 2.1 time: 0.447887 Jan 21 09:42:22.272130 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 505/1005] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:42:21 2022] GET /compute/v2.1/servers/ef1ba7db-0bbf-44d8-ab58-f85d9194ecd6 => generated 1264 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:42:22.431740 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-9f1479a8-ad71-430a-9d3b-0239513c2889 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:42:22.432865 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-9f1479a8-ad71-430a-9d3b-0239513c2889 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] [instance: 9c18953a-7af3-4d71-97ad-05eda7e34a73] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:42:22.447809 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-9f1479a8-ad71-430a-9d3b-0239513c2889 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:42:22.448479 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-9f1479a8-ad71-430a-9d3b-0239513c2889 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:42:22.449473 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-9f1479a8-ad71-430a-9d3b-0239513c2889 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:42:22.450202 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-9f1479a8-ad71-430a-9d3b-0239513c2889 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:42:22.598605 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-3251b2d0-2b66-4bb9-badc-3db1139f6f51 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:42:22.599539 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-3251b2d0-2b66-4bb9-badc-3db1139f6f51 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] [instance: f4a4e6b7-47b1-4de2-8677-4f8e3eb056c2] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:42:22.608063 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-3251b2d0-2b66-4bb9-badc-3db1139f6f51 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:42:22.608705 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-3251b2d0-2b66-4bb9-badc-3db1139f6f51 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:42:22.610010 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-3251b2d0-2b66-4bb9-badc-3db1139f6f51 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:42:22.611202 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-3251b2d0-2b66-4bb9-badc-3db1139f6f51 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:42:22.817917 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-9f1479a8-ad71-430a-9d3b-0239513c2889 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '590e721135c84df5946147ac7e944fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2322cb784615409bb15a6f49522d3b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:42:22.833499 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-9f1479a8-ad71-430a-9d3b-0239513c2889 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] 10.222.0.45 "GET /compute/v2.1/servers/9c18953a-7af3-4d71-97ad-05eda7e34a73" status: 200 len: 1680 microversion: 2.1 time: 0.408882 Jan 21 09:42:22.834931 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 501/1006] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:42:22 2022] GET /compute/v2.1/servers/9c18953a-7af3-4d71-97ad-05eda7e34a73 => generated 1680 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:42:22.842865 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-ca6d9173-c7fc-4caf-bc12-98ecfb6bf5fe tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:42:22.843698 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-ca6d9173-c7fc-4caf-bc12-98ecfb6bf5fe tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] [instance: e3dd8a17-5a2f-4f39-a110-208165e07110] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:42:22.852927 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-ca6d9173-c7fc-4caf-bc12-98ecfb6bf5fe tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:42:22.853626 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-ca6d9173-c7fc-4caf-bc12-98ecfb6bf5fe tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:42:22.854652 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-ca6d9173-c7fc-4caf-bc12-98ecfb6bf5fe tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:42:22.855319 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-ca6d9173-c7fc-4caf-bc12-98ecfb6bf5fe tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:42:23.008725 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-3251b2d0-2b66-4bb9-badc-3db1139f6f51 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aed8f68a416468cb303ae6c59a2203c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ac0334d1e14c29aa6222d547c64b00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:42:23.024389 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-3251b2d0-2b66-4bb9-badc-3db1139f6f51 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] 10.222.0.45 "GET /compute/v2.1/servers/f4a4e6b7-47b1-4de2-8677-4f8e3eb056c2" status: 200 len: 1259 microversion: 2.1 time: 0.432040 Jan 21 09:42:23.025763 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 506/1007] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:42:22 2022] GET /compute/v2.1/servers/f4a4e6b7-47b1-4de2-8677-4f8e3eb056c2 => generated 1259 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 09:42:23.153878 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-ca6d9173-c7fc-4caf-bc12-98ecfb6bf5fe tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:42:23.163217 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-ca6d9173-c7fc-4caf-bc12-98ecfb6bf5fe tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:42:23.164752 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-ca6d9173-c7fc-4caf-bc12-98ecfb6bf5fe tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:42:23.166007 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-ca6d9173-c7fc-4caf-bc12-98ecfb6bf5fe tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "GET /compute/v2.1/servers/e3dd8a17-5a2f-4f39-a110-208165e07110" status: 200 len: 1731 microversion: 2.20 time: 0.329350 Jan 21 09:42:23.167057 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 502/1008] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jan 21 09:42:22 2022] GET /compute/v2.1/servers/e3dd8a17-5a2f-4f39-a110-208165e07110 => generated 1731 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 21 09:42:23.291719 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-0848e63d-fc4b-4199-85c6-7de2e04d829d tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:42:23.292891 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-0848e63d-fc4b-4199-85c6-7de2e04d829d tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] [instance: ef1ba7db-0bbf-44d8-ab58-f85d9194ecd6] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:42:23.302076 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-0848e63d-fc4b-4199-85c6-7de2e04d829d tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:42:23.302802 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-0848e63d-fc4b-4199-85c6-7de2e04d829d tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:42:23.303739 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-0848e63d-fc4b-4199-85c6-7de2e04d829d tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:42:23.304612 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-0848e63d-fc4b-4199-85c6-7de2e04d829d tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:42:23.481882 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-0848e63d-fc4b-4199-85c6-7de2e04d829d tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d53a7fa2cb5498aa916817b82dba77e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515ded26ca114fbf9c6e920362aec64c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:42:23.490500 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-0848e63d-fc4b-4199-85c6-7de2e04d829d tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] 10.222.0.45 "GET /compute/v2.1/servers/ef1ba7db-0bbf-44d8-ab58-f85d9194ecd6" status: 200 len: 1264 microversion: 2.1 time: 0.203069 Jan 21 09:42:23.491299 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 507/1009] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:42:23 2022] GET /compute/v2.1/servers/ef1ba7db-0bbf-44d8-ab58-f85d9194ecd6 => generated 1264 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:42:23.866956 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-22fb44b9-0c9e-402b-b107-fe4b4e728a50 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:42:23.868392 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-22fb44b9-0c9e-402b-b107-fe4b4e728a50 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] [instance: 9c18953a-7af3-4d71-97ad-05eda7e34a73] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:42:23.883170 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-22fb44b9-0c9e-402b-b107-fe4b4e728a50 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:42:23.884623 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-22fb44b9-0c9e-402b-b107-fe4b4e728a50 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:42:23.886907 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-22fb44b9-0c9e-402b-b107-fe4b4e728a50 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:42:23.888140 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-22fb44b9-0c9e-402b-b107-fe4b4e728a50 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:42:24.055478 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-145579a4-0d55-4caf-8599-4964a670ebba tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:42:24.056613 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-145579a4-0d55-4caf-8599-4964a670ebba tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] [instance: f4a4e6b7-47b1-4de2-8677-4f8e3eb056c2] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:42:24.075464 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-145579a4-0d55-4caf-8599-4964a670ebba tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:42:24.076595 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-145579a4-0d55-4caf-8599-4964a670ebba tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:42:24.079047 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-145579a4-0d55-4caf-8599-4964a670ebba tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:42:24.080875 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-145579a4-0d55-4caf-8599-4964a670ebba tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:42:24.235018 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-22fb44b9-0c9e-402b-b107-fe4b4e728a50 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '590e721135c84df5946147ac7e944fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2322cb784615409bb15a6f49522d3b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:42:24.252091 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-22fb44b9-0c9e-402b-b107-fe4b4e728a50 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] 10.222.0.45 "GET /compute/v2.1/servers/9c18953a-7af3-4d71-97ad-05eda7e34a73" status: 200 len: 1680 microversion: 2.1 time: 0.392797 Jan 21 09:42:24.255925 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 503/1010] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:42:23 2022] GET /compute/v2.1/servers/9c18953a-7af3-4d71-97ad-05eda7e34a73 => generated 1680 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:42:24.277202 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [req-5e6ec5b9-a945-40ae-b826-300142d923d5 req-ab21dd64-f4bf-4b06-9ffa-ff427dff9c43 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4a4e6b7-47b1-4de2-8677-4f8e3eb056c2", "name": "network-vif-plugged", "status": "completed", "tag": "0e43678c-54de-414e-81b5-5773897a97f4"}]} {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:42:24.288231 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 21 09:42:24.288231 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: warnings.warn(msg) Jan 21 09:42:24.317708 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [req-5e6ec5b9-a945-40ae-b826-300142d923d5 req-ab21dd64-f4bf-4b06-9ffa-ff427dff9c43 service nova] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:42:24.318424 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [req-5e6ec5b9-a945-40ae-b826-300142d923d5 req-ab21dd64-f4bf-4b06-9ffa-ff427dff9c43 service nova] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:42:24.354413 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.compute.server_external_events [req-5e6ec5b9-a945-40ae-b826-300142d923d5 req-ab21dd64-f4bf-4b06-9ffa-ff427dff9c43 service nova] Creating event network-vif-plugged:0e43678c-54de-414e-81b5-5773897a97f4 for instance f4a4e6b7-47b1-4de2-8677-4f8e3eb056c2 on hv-cinder-80403 Jan 21 09:42:24.383090 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [req-5e6ec5b9-a945-40ae-b826-300142d923d5 req-ab21dd64-f4bf-4b06-9ffa-ff427dff9c43 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105091 Jan 21 09:42:24.388657 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 504/1011] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Jan 21 09:42:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 09:42:24.401874 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-7f8384e0-958e-44e3-a9d6-d3b05c4dce21 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:42:24.402729 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-7f8384e0-958e-44e3-a9d6-d3b05c4dce21 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] [instance: e3dd8a17-5a2f-4f39-a110-208165e07110] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:42:24.469946 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-145579a4-0d55-4caf-8599-4964a670ebba tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aed8f68a416468cb303ae6c59a2203c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ac0334d1e14c29aa6222d547c64b00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:42:24.482953 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-7f8384e0-958e-44e3-a9d6-d3b05c4dce21 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:42:24.483806 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-7f8384e0-958e-44e3-a9d6-d3b05c4dce21 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:42:24.486428 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-7f8384e0-958e-44e3-a9d6-d3b05c4dce21 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:42:24.496012 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-145579a4-0d55-4caf-8599-4964a670ebba tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] 10.222.0.45 "GET /compute/v2.1/servers/f4a4e6b7-47b1-4de2-8677-4f8e3eb056c2" status: 200 len: 1259 microversion: 2.1 time: 0.445350 Jan 21 09:42:24.498041 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-7f8384e0-958e-44e3-a9d6-d3b05c4dce21 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:42:24.502414 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 508/1012] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:42:24 2022] GET /compute/v2.1/servers/f4a4e6b7-47b1-4de2-8677-4f8e3eb056c2 => generated 1259 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:42:24.530691 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-c24d1728-a8b8-4f19-aa12-524d49b5e45a tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:42:24.537688 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-c24d1728-a8b8-4f19-aa12-524d49b5e45a tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] [instance: ef1ba7db-0bbf-44d8-ab58-f85d9194ecd6] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:42:24.566431 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-c24d1728-a8b8-4f19-aa12-524d49b5e45a tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:42:24.568626 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-c24d1728-a8b8-4f19-aa12-524d49b5e45a tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:42:24.570130 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-c24d1728-a8b8-4f19-aa12-524d49b5e45a tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:42:24.575066 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-c24d1728-a8b8-4f19-aa12-524d49b5e45a tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:42:25.010244 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-7f8384e0-958e-44e3-a9d6-d3b05c4dce21 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:42:25.029088 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-c24d1728-a8b8-4f19-aa12-524d49b5e45a tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d53a7fa2cb5498aa916817b82dba77e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515ded26ca114fbf9c6e920362aec64c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:42:25.038861 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-7f8384e0-958e-44e3-a9d6-d3b05c4dce21 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:42:25.040568 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-c24d1728-a8b8-4f19-aa12-524d49b5e45a tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] 10.222.0.45 "GET /compute/v2.1/servers/ef1ba7db-0bbf-44d8-ab58-f85d9194ecd6" status: 200 len: 1264 microversion: 2.1 time: 0.535002 Jan 21 09:42:25.048904 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 509/1013] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:42:24 2022] GET /compute/v2.1/servers/ef1ba7db-0bbf-44d8-ab58-f85d9194ecd6 => generated 1264 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 09:42:25.049410 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-7f8384e0-958e-44e3-a9d6-d3b05c4dce21 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:42:25.049410 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-7f8384e0-958e-44e3-a9d6-d3b05c4dce21 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "GET /compute/v2.1/servers/e3dd8a17-5a2f-4f39-a110-208165e07110" status: 200 len: 1731 microversion: 2.20 time: 0.654246 Jan 21 09:42:25.049410 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 505/1014] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jan 21 09:42:24 2022] GET /compute/v2.1/servers/e3dd8a17-5a2f-4f39-a110-208165e07110 => generated 1731 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 21 09:42:25.287156 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-337af286-8513-4463-877d-22620ee58777 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:42:25.288867 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-337af286-8513-4463-877d-22620ee58777 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] [instance: 9c18953a-7af3-4d71-97ad-05eda7e34a73] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:42:25.308954 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-337af286-8513-4463-877d-22620ee58777 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:42:25.310282 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-337af286-8513-4463-877d-22620ee58777 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:42:25.312128 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-337af286-8513-4463-877d-22620ee58777 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:42:25.313346 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-337af286-8513-4463-877d-22620ee58777 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:42:25.532077 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-337af286-8513-4463-877d-22620ee58777 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '590e721135c84df5946147ac7e944fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2322cb784615409bb15a6f49522d3b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:42:25.536050 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-a7257aab-c53f-4964-9f36-ed91cb054778 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:42:25.537586 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-a7257aab-c53f-4964-9f36-ed91cb054778 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] [instance: f4a4e6b7-47b1-4de2-8677-4f8e3eb056c2] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:42:25.548666 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-337af286-8513-4463-877d-22620ee58777 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] 10.222.0.45 "GET /compute/v2.1/servers/9c18953a-7af3-4d71-97ad-05eda7e34a73" status: 200 len: 1680 microversion: 2.1 time: 0.276209 Jan 21 09:42:25.549696 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 510/1015] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:42:25 2022] GET /compute/v2.1/servers/9c18953a-7af3-4d71-97ad-05eda7e34a73 => generated 1680 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:42:25.564630 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-a7257aab-c53f-4964-9f36-ed91cb054778 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:42:25.565843 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-a7257aab-c53f-4964-9f36-ed91cb054778 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:42:25.567550 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-a7257aab-c53f-4964-9f36-ed91cb054778 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:42:25.577929 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-a7257aab-c53f-4964-9f36-ed91cb054778 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:42:25.864413 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-a7257aab-c53f-4964-9f36-ed91cb054778 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aed8f68a416468cb303ae6c59a2203c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ac0334d1e14c29aa6222d547c64b00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:42:25.875760 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-a7257aab-c53f-4964-9f36-ed91cb054778 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] 10.222.0.45 "GET /compute/v2.1/servers/f4a4e6b7-47b1-4de2-8677-4f8e3eb056c2" status: 200 len: 1259 microversion: 2.1 time: 0.347235 Jan 21 09:42:25.888081 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 506/1016] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:42:25 2022] GET /compute/v2.1/servers/f4a4e6b7-47b1-4de2-8677-4f8e3eb056c2 => generated 1259 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 09:42:26.059913 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-1dc57283-f806-4bc2-9b1b-4139b77a0c80 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:42:26.060535 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-1dc57283-f806-4bc2-9b1b-4139b77a0c80 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] [instance: ef1ba7db-0bbf-44d8-ab58-f85d9194ecd6] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:42:26.068209 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-1dc57283-f806-4bc2-9b1b-4139b77a0c80 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:42:26.068662 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-1dc57283-f806-4bc2-9b1b-4139b77a0c80 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:42:26.069682 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-1dc57283-f806-4bc2-9b1b-4139b77a0c80 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:42:26.069991 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-1dc57283-f806-4bc2-9b1b-4139b77a0c80 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:42:26.070783 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-b9ca09ac-2f4d-485c-9dd1-533e4492a5a5 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:42:26.071900 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-b9ca09ac-2f4d-485c-9dd1-533e4492a5a5 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] [instance: e3dd8a17-5a2f-4f39-a110-208165e07110] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:42:26.082322 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-b9ca09ac-2f4d-485c-9dd1-533e4492a5a5 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:42:26.082812 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-b9ca09ac-2f4d-485c-9dd1-533e4492a5a5 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:42:26.083686 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-b9ca09ac-2f4d-485c-9dd1-533e4492a5a5 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:42:26.084136 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-b9ca09ac-2f4d-485c-9dd1-533e4492a5a5 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:42:26.396800 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-1dc57283-f806-4bc2-9b1b-4139b77a0c80 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d53a7fa2cb5498aa916817b82dba77e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515ded26ca114fbf9c6e920362aec64c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:42:26.412947 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-1dc57283-f806-4bc2-9b1b-4139b77a0c80 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] 10.222.0.45 "GET /compute/v2.1/servers/ef1ba7db-0bbf-44d8-ab58-f85d9194ecd6" status: 200 len: 1264 microversion: 2.1 time: 0.356445 Jan 21 09:42:26.415108 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 511/1017] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:42:26 2022] GET /compute/v2.1/servers/ef1ba7db-0bbf-44d8-ab58-f85d9194ecd6 => generated 1264 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:42:26.456917 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-b9ca09ac-2f4d-485c-9dd1-533e4492a5a5 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:42:26.472772 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-b9ca09ac-2f4d-485c-9dd1-533e4492a5a5 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:42:26.474315 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-b9ca09ac-2f4d-485c-9dd1-533e4492a5a5 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:42:26.475536 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-b9ca09ac-2f4d-485c-9dd1-533e4492a5a5 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "GET /compute/v2.1/servers/e3dd8a17-5a2f-4f39-a110-208165e07110" status: 200 len: 1731 microversion: 2.20 time: 0.410413 Jan 21 09:42:26.482442 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 507/1018] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jan 21 09:42:26 2022] GET /compute/v2.1/servers/e3dd8a17-5a2f-4f39-a110-208165e07110 => generated 1731 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 21 09:42:26.568265 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-c26ddf42-59f7-4a71-b891-84feaea65b21 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:42:26.568874 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-c26ddf42-59f7-4a71-b891-84feaea65b21 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] [instance: 9c18953a-7af3-4d71-97ad-05eda7e34a73] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:42:26.575097 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-c26ddf42-59f7-4a71-b891-84feaea65b21 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:42:26.575551 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-c26ddf42-59f7-4a71-b891-84feaea65b21 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:42:26.578004 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-c26ddf42-59f7-4a71-b891-84feaea65b21 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:42:26.578004 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-c26ddf42-59f7-4a71-b891-84feaea65b21 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:42:26.778990 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-c26ddf42-59f7-4a71-b891-84feaea65b21 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '590e721135c84df5946147ac7e944fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2322cb784615409bb15a6f49522d3b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:42:26.790204 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-c26ddf42-59f7-4a71-b891-84feaea65b21 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] 10.222.0.45 "GET /compute/v2.1/servers/9c18953a-7af3-4d71-97ad-05eda7e34a73" status: 200 len: 1680 microversion: 2.1 time: 0.226072 Jan 21 09:42:26.790905 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 512/1019] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:42:26 2022] GET /compute/v2.1/servers/9c18953a-7af3-4d71-97ad-05eda7e34a73 => generated 1680 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:42:26.900800 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-3020bd04-7e8c-40da-b23f-6b8241ab4501 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:42:26.902644 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-3020bd04-7e8c-40da-b23f-6b8241ab4501 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] [instance: f4a4e6b7-47b1-4de2-8677-4f8e3eb056c2] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:42:26.915197 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-3020bd04-7e8c-40da-b23f-6b8241ab4501 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:42:26.916147 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-3020bd04-7e8c-40da-b23f-6b8241ab4501 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:42:26.917719 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-3020bd04-7e8c-40da-b23f-6b8241ab4501 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:42:26.918468 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-3020bd04-7e8c-40da-b23f-6b8241ab4501 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:42:27.141029 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-3020bd04-7e8c-40da-b23f-6b8241ab4501 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aed8f68a416468cb303ae6c59a2203c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ac0334d1e14c29aa6222d547c64b00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:42:27.151677 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-3020bd04-7e8c-40da-b23f-6b8241ab4501 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] 10.222.0.45 "GET /compute/v2.1/servers/f4a4e6b7-47b1-4de2-8677-4f8e3eb056c2" status: 200 len: 1259 microversion: 2.1 time: 0.258672 Jan 21 09:42:27.152863 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 508/1020] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:42:26 2022] GET /compute/v2.1/servers/f4a4e6b7-47b1-4de2-8677-4f8e3eb056c2 => generated 1259 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:42:27.436175 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-f20b16c8-0517-4910-bdeb-6d9533a87270 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:42:27.437761 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-f20b16c8-0517-4910-bdeb-6d9533a87270 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] [instance: ef1ba7db-0bbf-44d8-ab58-f85d9194ecd6] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:42:27.461809 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-f20b16c8-0517-4910-bdeb-6d9533a87270 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:42:27.463139 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-f20b16c8-0517-4910-bdeb-6d9533a87270 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:42:27.464885 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-f20b16c8-0517-4910-bdeb-6d9533a87270 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:42:27.466234 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-f20b16c8-0517-4910-bdeb-6d9533a87270 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:42:27.499813 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-ff99f8eb-dd0b-4aa8-ac99-7ed6b3978a4d tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:42:27.505094 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-ff99f8eb-dd0b-4aa8-ac99-7ed6b3978a4d tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] [instance: e3dd8a17-5a2f-4f39-a110-208165e07110] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:42:27.524827 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-ff99f8eb-dd0b-4aa8-ac99-7ed6b3978a4d tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:42:27.525319 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-ff99f8eb-dd0b-4aa8-ac99-7ed6b3978a4d tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:42:27.526381 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-ff99f8eb-dd0b-4aa8-ac99-7ed6b3978a4d tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:42:27.526838 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-ff99f8eb-dd0b-4aa8-ac99-7ed6b3978a4d tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:42:27.819700 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-f20b16c8-0517-4910-bdeb-6d9533a87270 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d53a7fa2cb5498aa916817b82dba77e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515ded26ca114fbf9c6e920362aec64c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:42:27.833837 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-f20b16c8-0517-4910-bdeb-6d9533a87270 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] 10.222.0.45 "GET /compute/v2.1/servers/ef1ba7db-0bbf-44d8-ab58-f85d9194ecd6" status: 200 len: 1264 microversion: 2.1 time: 0.404341 Jan 21 09:42:27.837543 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 513/1021] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:42:27 2022] GET /compute/v2.1/servers/ef1ba7db-0bbf-44d8-ab58-f85d9194ecd6 => generated 1264 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:42:27.846917 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-12fd6d16-d713-4bab-b337-8af7af316a58 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:42:27.853212 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-12fd6d16-d713-4bab-b337-8af7af316a58 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] [instance: 9c18953a-7af3-4d71-97ad-05eda7e34a73] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:42:27.864479 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-12fd6d16-d713-4bab-b337-8af7af316a58 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:42:27.875030 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-12fd6d16-d713-4bab-b337-8af7af316a58 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:42:27.875030 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-12fd6d16-d713-4bab-b337-8af7af316a58 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:42:27.875030 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-12fd6d16-d713-4bab-b337-8af7af316a58 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:42:27.936620 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-ff99f8eb-dd0b-4aa8-ac99-7ed6b3978a4d tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:42:27.968095 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-ff99f8eb-dd0b-4aa8-ac99-7ed6b3978a4d tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:42:27.972517 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-ff99f8eb-dd0b-4aa8-ac99-7ed6b3978a4d tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:42:27.980552 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-ff99f8eb-dd0b-4aa8-ac99-7ed6b3978a4d tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "GET /compute/v2.1/servers/e3dd8a17-5a2f-4f39-a110-208165e07110" status: 200 len: 1731 microversion: 2.20 time: 0.489000 Jan 21 09:42:27.982236 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 509/1022] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jan 21 09:42:27 2022] GET /compute/v2.1/servers/e3dd8a17-5a2f-4f39-a110-208165e07110 => generated 1731 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 21 09:42:28.192054 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-39660e0e-5a3b-4d30-a73d-75e280017460 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:42:28.200007 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-39660e0e-5a3b-4d30-a73d-75e280017460 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] [instance: f4a4e6b7-47b1-4de2-8677-4f8e3eb056c2] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:42:28.211941 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-12fd6d16-d713-4bab-b337-8af7af316a58 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '590e721135c84df5946147ac7e944fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2322cb784615409bb15a6f49522d3b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:42:28.222009 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-39660e0e-5a3b-4d30-a73d-75e280017460 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:42:28.222755 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-39660e0e-5a3b-4d30-a73d-75e280017460 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:42:28.224251 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-39660e0e-5a3b-4d30-a73d-75e280017460 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:42:28.225066 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-39660e0e-5a3b-4d30-a73d-75e280017460 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:42:28.236881 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-12fd6d16-d713-4bab-b337-8af7af316a58 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] 10.222.0.45 "GET /compute/v2.1/servers/9c18953a-7af3-4d71-97ad-05eda7e34a73" status: 200 len: 1680 microversion: 2.1 time: 0.388815 Jan 21 09:42:28.252619 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 514/1023] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:42:27 2022] GET /compute/v2.1/servers/9c18953a-7af3-4d71-97ad-05eda7e34a73 => generated 1680 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:42:28.458680 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-39660e0e-5a3b-4d30-a73d-75e280017460 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aed8f68a416468cb303ae6c59a2203c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ac0334d1e14c29aa6222d547c64b00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:42:28.474201 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-39660e0e-5a3b-4d30-a73d-75e280017460 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] 10.222.0.45 "GET /compute/v2.1/servers/f4a4e6b7-47b1-4de2-8677-4f8e3eb056c2" status: 200 len: 1259 microversion: 2.1 time: 0.305703 Jan 21 09:42:28.474201 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 510/1024] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:42:28 2022] GET /compute/v2.1/servers/f4a4e6b7-47b1-4de2-8677-4f8e3eb056c2 => generated 1259 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 09:42:28.861301 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-272002e8-ddd3-4f73-80f1-327b6a614183 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:42:28.863698 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-272002e8-ddd3-4f73-80f1-327b6a614183 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] [instance: ef1ba7db-0bbf-44d8-ab58-f85d9194ecd6] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:42:28.877977 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-272002e8-ddd3-4f73-80f1-327b6a614183 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:42:28.878849 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-272002e8-ddd3-4f73-80f1-327b6a614183 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:42:28.880446 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-272002e8-ddd3-4f73-80f1-327b6a614183 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:42:28.881453 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-272002e8-ddd3-4f73-80f1-327b6a614183 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:42:29.013561 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-a913555b-f67b-43bd-adaa-77db7926bb88 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:42:29.013561 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-a913555b-f67b-43bd-adaa-77db7926bb88 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] [instance: e3dd8a17-5a2f-4f39-a110-208165e07110] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:42:29.025275 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-a913555b-f67b-43bd-adaa-77db7926bb88 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:42:29.026246 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-a913555b-f67b-43bd-adaa-77db7926bb88 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:42:29.027863 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-a913555b-f67b-43bd-adaa-77db7926bb88 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:42:29.028726 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-a913555b-f67b-43bd-adaa-77db7926bb88 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:42:29.613765 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-272002e8-ddd3-4f73-80f1-327b6a614183 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d53a7fa2cb5498aa916817b82dba77e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515ded26ca114fbf9c6e920362aec64c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:42:29.619690 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-a913555b-f67b-43bd-adaa-77db7926bb88 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:42:29.630876 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-a913555b-f67b-43bd-adaa-77db7926bb88 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:42:29.635248 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-a913555b-f67b-43bd-adaa-77db7926bb88 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:42:29.635672 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-272002e8-ddd3-4f73-80f1-327b6a614183 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] 10.222.0.45 "GET /compute/v2.1/servers/ef1ba7db-0bbf-44d8-ab58-f85d9194ecd6" status: 200 len: 1264 microversion: 2.1 time: 0.780817 Jan 21 09:42:29.635852 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-a913555b-f67b-43bd-adaa-77db7926bb88 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "GET /compute/v2.1/servers/e3dd8a17-5a2f-4f39-a110-208165e07110" status: 200 len: 1731 microversion: 2.20 time: 0.630296 Jan 21 09:42:29.646211 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 511/1025] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jan 21 09:42:29 2022] GET /compute/v2.1/servers/e3dd8a17-5a2f-4f39-a110-208165e07110 => generated 1731 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 21 09:42:29.648625 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 515/1026] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:42:28 2022] GET /compute/v2.1/servers/ef1ba7db-0bbf-44d8-ab58-f85d9194ecd6 => generated 1264 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:42:29.653260 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-f33f005e-eab3-4cbd-9708-6f7a885766de tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:42:29.653260 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-f33f005e-eab3-4cbd-9708-6f7a885766de tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] [instance: 9c18953a-7af3-4d71-97ad-05eda7e34a73] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:42:29.655828 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-1adaa54d-157d-4ae7-9da9-3e242c9f63cf tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:42:29.657317 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-1adaa54d-157d-4ae7-9da9-3e242c9f63cf tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] [instance: f4a4e6b7-47b1-4de2-8677-4f8e3eb056c2] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:42:29.660399 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-f33f005e-eab3-4cbd-9708-6f7a885766de tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:42:29.660961 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-f33f005e-eab3-4cbd-9708-6f7a885766de tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:42:29.661911 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-f33f005e-eab3-4cbd-9708-6f7a885766de tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:42:29.662418 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-f33f005e-eab3-4cbd-9708-6f7a885766de tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:42:29.667431 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-1adaa54d-157d-4ae7-9da9-3e242c9f63cf tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:42:29.668267 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-1adaa54d-157d-4ae7-9da9-3e242c9f63cf tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:42:29.669785 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-1adaa54d-157d-4ae7-9da9-3e242c9f63cf tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:42:29.670593 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-1adaa54d-157d-4ae7-9da9-3e242c9f63cf tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:42:29.918885 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-f33f005e-eab3-4cbd-9708-6f7a885766de tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '590e721135c84df5946147ac7e944fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2322cb784615409bb15a6f49522d3b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:42:29.928338 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-1adaa54d-157d-4ae7-9da9-3e242c9f63cf tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aed8f68a416468cb303ae6c59a2203c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ac0334d1e14c29aa6222d547c64b00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:42:29.930613 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-f33f005e-eab3-4cbd-9708-6f7a885766de tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] 10.222.0.45 "GET /compute/v2.1/servers/9c18953a-7af3-4d71-97ad-05eda7e34a73" status: 200 len: 1680 microversion: 2.1 time: 0.282657 Jan 21 09:42:29.931705 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 512/1027] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:42:29 2022] GET /compute/v2.1/servers/9c18953a-7af3-4d71-97ad-05eda7e34a73 => generated 1680 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:42:29.939988 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-1adaa54d-157d-4ae7-9da9-3e242c9f63cf tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] 10.222.0.45 "GET /compute/v2.1/servers/f4a4e6b7-47b1-4de2-8677-4f8e3eb056c2" status: 200 len: 1259 microversion: 2.1 time: 0.290011 Jan 21 09:42:29.940774 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 516/1028] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:42:29 2022] GET /compute/v2.1/servers/f4a4e6b7-47b1-4de2-8677-4f8e3eb056c2 => generated 1259 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:42:30.660356 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-31628f46-35a9-44ee-8cbb-ecd3fa02ac14 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:42:30.669277 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-99eb8721-cdfd-4f41-8224-41be4fbfcb45 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:42:30.670349 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-99eb8721-cdfd-4f41-8224-41be4fbfcb45 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] [instance: ef1ba7db-0bbf-44d8-ab58-f85d9194ecd6] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:42:30.673674 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-31628f46-35a9-44ee-8cbb-ecd3fa02ac14 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] [instance: e3dd8a17-5a2f-4f39-a110-208165e07110] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:42:30.689414 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-31628f46-35a9-44ee-8cbb-ecd3fa02ac14 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:42:30.693131 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-99eb8721-cdfd-4f41-8224-41be4fbfcb45 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:42:30.693131 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-99eb8721-cdfd-4f41-8224-41be4fbfcb45 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:42:30.693131 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-99eb8721-cdfd-4f41-8224-41be4fbfcb45 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:42:30.693131 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-99eb8721-cdfd-4f41-8224-41be4fbfcb45 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:42:30.695966 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-31628f46-35a9-44ee-8cbb-ecd3fa02ac14 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:42:30.699729 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-31628f46-35a9-44ee-8cbb-ecd3fa02ac14 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:42:30.700313 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-31628f46-35a9-44ee-8cbb-ecd3fa02ac14 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:42:31.026915 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-31628f46-35a9-44ee-8cbb-ecd3fa02ac14 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:42:31.032145 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-99eb8721-cdfd-4f41-8224-41be4fbfcb45 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d53a7fa2cb5498aa916817b82dba77e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515ded26ca114fbf9c6e920362aec64c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:42:31.037501 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-31628f46-35a9-44ee-8cbb-ecd3fa02ac14 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:42:31.039043 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-31628f46-35a9-44ee-8cbb-ecd3fa02ac14 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:42:31.040249 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-31628f46-35a9-44ee-8cbb-ecd3fa02ac14 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "GET /compute/v2.1/servers/e3dd8a17-5a2f-4f39-a110-208165e07110" status: 200 len: 1731 microversion: 2.20 time: 0.387161 Jan 21 09:42:31.040824 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 513/1029] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jan 21 09:42:30 2022] GET /compute/v2.1/servers/e3dd8a17-5a2f-4f39-a110-208165e07110 => generated 1731 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 21 09:42:31.046643 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-e65e1a0c-daa6-4102-9e56-31472dd73dac tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:42:31.047405 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-e65e1a0c-daa6-4102-9e56-31472dd73dac tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] [instance: 9c18953a-7af3-4d71-97ad-05eda7e34a73] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:42:31.055465 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-e65e1a0c-daa6-4102-9e56-31472dd73dac tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:42:31.056014 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-e65e1a0c-daa6-4102-9e56-31472dd73dac tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:42:31.056888 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-e65e1a0c-daa6-4102-9e56-31472dd73dac tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:42:31.057408 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-e65e1a0c-daa6-4102-9e56-31472dd73dac tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:42:31.058067 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-99eb8721-cdfd-4f41-8224-41be4fbfcb45 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] 10.222.0.45 "GET /compute/v2.1/servers/ef1ba7db-0bbf-44d8-ab58-f85d9194ecd6" status: 200 len: 1264 microversion: 2.1 time: 0.391351 Jan 21 09:42:31.059591 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 517/1030] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:42:30 2022] GET /compute/v2.1/servers/ef1ba7db-0bbf-44d8-ab58-f85d9194ecd6 => generated 1264 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:42:31.070604 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-ef51f62d-0dde-43c2-8e0d-93004eb9ff58 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:42:31.072275 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-ef51f62d-0dde-43c2-8e0d-93004eb9ff58 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] [instance: f4a4e6b7-47b1-4de2-8677-4f8e3eb056c2] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:42:31.083082 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-ef51f62d-0dde-43c2-8e0d-93004eb9ff58 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:42:31.083876 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-ef51f62d-0dde-43c2-8e0d-93004eb9ff58 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:42:31.085328 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-ef51f62d-0dde-43c2-8e0d-93004eb9ff58 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:42:31.086147 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-ef51f62d-0dde-43c2-8e0d-93004eb9ff58 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:42:31.386537 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-e65e1a0c-daa6-4102-9e56-31472dd73dac tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '590e721135c84df5946147ac7e944fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2322cb784615409bb15a6f49522d3b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:42:31.397280 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-e65e1a0c-daa6-4102-9e56-31472dd73dac tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] 10.222.0.45 "GET /compute/v2.1/servers/9c18953a-7af3-4d71-97ad-05eda7e34a73" status: 200 len: 1680 microversion: 2.1 time: 0.355198 Jan 21 09:42:31.404128 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 514/1031] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:42:31 2022] GET /compute/v2.1/servers/9c18953a-7af3-4d71-97ad-05eda7e34a73 => generated 1680 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:42:31.430006 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-ef51f62d-0dde-43c2-8e0d-93004eb9ff58 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aed8f68a416468cb303ae6c59a2203c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ac0334d1e14c29aa6222d547c64b00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:42:31.439494 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-ef51f62d-0dde-43c2-8e0d-93004eb9ff58 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] 10.222.0.45 "GET /compute/v2.1/servers/f4a4e6b7-47b1-4de2-8677-4f8e3eb056c2" status: 200 len: 1259 microversion: 2.1 time: 0.376734 Jan 21 09:42:31.440191 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 518/1032] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:42:31 2022] GET /compute/v2.1/servers/f4a4e6b7-47b1-4de2-8677-4f8e3eb056c2 => generated 1259 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:42:32.064781 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-eb2b5b98-7c25-42cb-945a-9f7d03f3fb54 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:42:32.065518 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-eb2b5b98-7c25-42cb-945a-9f7d03f3fb54 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] [instance: e3dd8a17-5a2f-4f39-a110-208165e07110] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:42:32.072510 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-eb2b5b98-7c25-42cb-945a-9f7d03f3fb54 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:42:32.072964 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-eb2b5b98-7c25-42cb-945a-9f7d03f3fb54 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:42:32.073808 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-eb2b5b98-7c25-42cb-945a-9f7d03f3fb54 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:42:32.074250 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-eb2b5b98-7c25-42cb-945a-9f7d03f3fb54 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:42:32.090034 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-d20d0589-10f7-4f5f-aea0-1e8587854fa4 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:42:32.090889 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-d20d0589-10f7-4f5f-aea0-1e8587854fa4 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] [instance: ef1ba7db-0bbf-44d8-ab58-f85d9194ecd6] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:42:32.100343 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-d20d0589-10f7-4f5f-aea0-1e8587854fa4 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:42:32.101079 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-d20d0589-10f7-4f5f-aea0-1e8587854fa4 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:42:32.102606 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-d20d0589-10f7-4f5f-aea0-1e8587854fa4 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:42:32.103397 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-d20d0589-10f7-4f5f-aea0-1e8587854fa4 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:42:32.297521 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-eb2b5b98-7c25-42cb-945a-9f7d03f3fb54 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:42:32.307192 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-eb2b5b98-7c25-42cb-945a-9f7d03f3fb54 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:42:32.308780 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-eb2b5b98-7c25-42cb-945a-9f7d03f3fb54 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:42:32.310015 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-eb2b5b98-7c25-42cb-945a-9f7d03f3fb54 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "GET /compute/v2.1/servers/e3dd8a17-5a2f-4f39-a110-208165e07110" status: 200 len: 1731 microversion: 2.20 time: 0.249788 Jan 21 09:42:32.310611 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 515/1033] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jan 21 09:42:32 2022] GET /compute/v2.1/servers/e3dd8a17-5a2f-4f39-a110-208165e07110 => generated 1731 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 21 09:42:32.364251 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-d20d0589-10f7-4f5f-aea0-1e8587854fa4 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d53a7fa2cb5498aa916817b82dba77e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515ded26ca114fbf9c6e920362aec64c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:42:32.372016 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-d20d0589-10f7-4f5f-aea0-1e8587854fa4 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] 10.222.0.45 "GET /compute/v2.1/servers/ef1ba7db-0bbf-44d8-ab58-f85d9194ecd6" status: 200 len: 1264 microversion: 2.1 time: 0.286137 Jan 21 09:42:32.372676 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 519/1034] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:42:32 2022] GET /compute/v2.1/servers/ef1ba7db-0bbf-44d8-ab58-f85d9194ecd6 => generated 1264 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 09:42:32.420635 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-b5a59170-2c7e-4d50-b7cb-ae861b10b1e2 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:42:32.421296 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-b5a59170-2c7e-4d50-b7cb-ae861b10b1e2 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] [instance: 9c18953a-7af3-4d71-97ad-05eda7e34a73] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:42:32.427896 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-b5a59170-2c7e-4d50-b7cb-ae861b10b1e2 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:42:32.428346 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-b5a59170-2c7e-4d50-b7cb-ae861b10b1e2 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:42:32.429207 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-b5a59170-2c7e-4d50-b7cb-ae861b10b1e2 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:42:32.429649 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-b5a59170-2c7e-4d50-b7cb-ae861b10b1e2 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:42:32.466234 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-b0d754f7-109f-4d45-99c2-22cb57a1dfc2 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:42:32.467026 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-b0d754f7-109f-4d45-99c2-22cb57a1dfc2 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] [instance: f4a4e6b7-47b1-4de2-8677-4f8e3eb056c2] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:42:32.474127 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-b0d754f7-109f-4d45-99c2-22cb57a1dfc2 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:42:32.474641 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-b0d754f7-109f-4d45-99c2-22cb57a1dfc2 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:42:32.475513 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-b0d754f7-109f-4d45-99c2-22cb57a1dfc2 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:42:32.476179 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-b0d754f7-109f-4d45-99c2-22cb57a1dfc2 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:42:32.648820 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-b5a59170-2c7e-4d50-b7cb-ae861b10b1e2 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '590e721135c84df5946147ac7e944fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2322cb784615409bb15a6f49522d3b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:42:32.663241 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-b5a59170-2c7e-4d50-b7cb-ae861b10b1e2 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] 10.222.0.45 "GET /compute/v2.1/servers/9c18953a-7af3-4d71-97ad-05eda7e34a73" status: 200 len: 1680 microversion: 2.1 time: 0.246228 Jan 21 09:42:32.677182 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 516/1035] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:42:32 2022] GET /compute/v2.1/servers/9c18953a-7af3-4d71-97ad-05eda7e34a73 => generated 1680 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:42:32.703276 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-b0d754f7-109f-4d45-99c2-22cb57a1dfc2 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aed8f68a416468cb303ae6c59a2203c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ac0334d1e14c29aa6222d547c64b00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:42:32.711177 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-b0d754f7-109f-4d45-99c2-22cb57a1dfc2 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] 10.222.0.45 "GET /compute/v2.1/servers/f4a4e6b7-47b1-4de2-8677-4f8e3eb056c2" status: 200 len: 1259 microversion: 2.1 time: 0.248647 Jan 21 09:42:32.711963 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 520/1036] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:42:32 2022] GET /compute/v2.1/servers/f4a4e6b7-47b1-4de2-8677-4f8e3eb056c2 => generated 1259 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 09:42:33.330011 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-f930415b-5815-48be-a80d-a56c2bc7ffeb tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:42:33.330790 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-f930415b-5815-48be-a80d-a56c2bc7ffeb tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] [instance: e3dd8a17-5a2f-4f39-a110-208165e07110] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:42:33.337417 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-f930415b-5815-48be-a80d-a56c2bc7ffeb tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:42:33.340525 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-f930415b-5815-48be-a80d-a56c2bc7ffeb tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:42:33.340525 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-f930415b-5815-48be-a80d-a56c2bc7ffeb tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:42:33.340525 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-f930415b-5815-48be-a80d-a56c2bc7ffeb tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:42:33.389411 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-ee4f1f56-5817-4f95-8ee1-d5cef3c6e8aa tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:42:33.390019 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-ee4f1f56-5817-4f95-8ee1-d5cef3c6e8aa tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] [instance: ef1ba7db-0bbf-44d8-ab58-f85d9194ecd6] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:42:33.397613 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-ee4f1f56-5817-4f95-8ee1-d5cef3c6e8aa tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:42:33.398060 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-ee4f1f56-5817-4f95-8ee1-d5cef3c6e8aa tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:42:33.398883 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-ee4f1f56-5817-4f95-8ee1-d5cef3c6e8aa tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:42:33.399306 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-ee4f1f56-5817-4f95-8ee1-d5cef3c6e8aa tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:42:33.545822 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-f930415b-5815-48be-a80d-a56c2bc7ffeb tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:42:33.555398 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-f930415b-5815-48be-a80d-a56c2bc7ffeb tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:42:33.558145 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-f930415b-5815-48be-a80d-a56c2bc7ffeb tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:42:33.558639 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-f930415b-5815-48be-a80d-a56c2bc7ffeb tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "GET /compute/v2.1/servers/e3dd8a17-5a2f-4f39-a110-208165e07110" status: 200 len: 1731 microversion: 2.20 time: 0.233077 Jan 21 09:42:33.559218 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 517/1037] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jan 21 09:42:33 2022] GET /compute/v2.1/servers/e3dd8a17-5a2f-4f39-a110-208165e07110 => generated 1731 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 21 09:42:33.601967 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-ee4f1f56-5817-4f95-8ee1-d5cef3c6e8aa tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d53a7fa2cb5498aa916817b82dba77e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515ded26ca114fbf9c6e920362aec64c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:42:33.611699 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-ee4f1f56-5817-4f95-8ee1-d5cef3c6e8aa tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] 10.222.0.45 "GET /compute/v2.1/servers/ef1ba7db-0bbf-44d8-ab58-f85d9194ecd6" status: 200 len: 1264 microversion: 2.1 time: 0.224921 Jan 21 09:42:33.612479 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 521/1038] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:42:33 2022] GET /compute/v2.1/servers/ef1ba7db-0bbf-44d8-ab58-f85d9194ecd6 => generated 1264 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 09:42:33.691470 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-5b874194-af32-40b7-8b2c-788ae5d495de tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:42:33.692096 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-5b874194-af32-40b7-8b2c-788ae5d495de tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] [instance: 9c18953a-7af3-4d71-97ad-05eda7e34a73] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:42:33.698619 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-5b874194-af32-40b7-8b2c-788ae5d495de tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:42:33.699069 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-5b874194-af32-40b7-8b2c-788ae5d495de tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:42:33.699887 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-5b874194-af32-40b7-8b2c-788ae5d495de tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:42:33.700326 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-5b874194-af32-40b7-8b2c-788ae5d495de tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:42:33.737060 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-52b270a7-5c75-4b03-9a10-52d379cc4f2e tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:42:33.738124 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-52b270a7-5c75-4b03-9a10-52d379cc4f2e tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] [instance: f4a4e6b7-47b1-4de2-8677-4f8e3eb056c2] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:42:33.747773 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-52b270a7-5c75-4b03-9a10-52d379cc4f2e tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:42:33.748486 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-52b270a7-5c75-4b03-9a10-52d379cc4f2e tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:42:33.749842 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-52b270a7-5c75-4b03-9a10-52d379cc4f2e tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:42:33.750527 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-52b270a7-5c75-4b03-9a10-52d379cc4f2e tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:42:34.035056 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-52b270a7-5c75-4b03-9a10-52d379cc4f2e tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aed8f68a416468cb303ae6c59a2203c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ac0334d1e14c29aa6222d547c64b00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:42:34.051522 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-52b270a7-5c75-4b03-9a10-52d379cc4f2e tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] 10.222.0.45 "GET /compute/v2.1/servers/f4a4e6b7-47b1-4de2-8677-4f8e3eb056c2" status: 200 len: 1443 microversion: 2.1 time: 0.321165 Jan 21 09:42:34.053211 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 522/1039] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:42:33 2022] GET /compute/v2.1/servers/f4a4e6b7-47b1-4de2-8677-4f8e3eb056c2 => generated 1443 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 09:42:34.072474 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-bb1d0eaf-f6a1-4f74-bac3-3ffc40063050 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:42:34.073222 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-bb1d0eaf-f6a1-4f74-bac3-3ffc40063050 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] [instance: f4a4e6b7-47b1-4de2-8677-4f8e3eb056c2] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:42:34.080721 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-bb1d0eaf-f6a1-4f74-bac3-3ffc40063050 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:42:34.081242 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-bb1d0eaf-f6a1-4f74-bac3-3ffc40063050 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:42:34.082441 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-bb1d0eaf-f6a1-4f74-bac3-3ffc40063050 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:42:34.082441 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-bb1d0eaf-f6a1-4f74-bac3-3ffc40063050 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:42:34.203874 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-5b874194-af32-40b7-8b2c-788ae5d495de tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '590e721135c84df5946147ac7e944fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2322cb784615409bb15a6f49522d3b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:42:34.219264 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-5b874194-af32-40b7-8b2c-788ae5d495de tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] 10.222.0.45 "GET /compute/v2.1/servers/9c18953a-7af3-4d71-97ad-05eda7e34a73" status: 200 len: 1657 microversion: 2.1 time: 0.532839 Jan 21 09:42:34.220523 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 518/1040] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:42:33 2022] GET /compute/v2.1/servers/9c18953a-7af3-4d71-97ad-05eda7e34a73 => generated 1657 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 09:42:34.240927 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-7aa3f720-caea-4b70-ad96-3210c98f339a tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:42:34.257829 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-7aa3f720-caea-4b70-ad96-3210c98f339a tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:42:34.258868 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-7aa3f720-caea-4b70-ad96-3210c98f339a tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:42:34.304159 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-7aa3f720-caea-4b70-ad96-3210c98f339a tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] [instance: 9c18953a-7af3-4d71-97ad-05eda7e34a73] Going to try to start instance {{(pid=123386) start /opt/stack/nova/nova/compute/api.py:2677}} Jan 21 09:42:34.369463 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-bb1d0eaf-f6a1-4f74-bac3-3ffc40063050 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aed8f68a416468cb303ae6c59a2203c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ac0334d1e14c29aa6222d547c64b00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:42:34.382544 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-bb1d0eaf-f6a1-4f74-bac3-3ffc40063050 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] 10.222.0.45 "GET /compute/v2.1/servers/f4a4e6b7-47b1-4de2-8677-4f8e3eb056c2" status: 200 len: 1443 microversion: 2.1 time: 0.314769 Jan 21 09:42:34.394811 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 523/1041] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:42:34 2022] GET /compute/v2.1/servers/f4a4e6b7-47b1-4de2-8677-4f8e3eb056c2 => generated 1443 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 09:42:34.545165 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-7aa3f720-caea-4b70-ad96-3210c98f339a tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] 10.222.0.45 "POST /compute/v2.1/servers/9c18953a-7af3-4d71-97ad-05eda7e34a73/action" status: 202 len: 0 microversion: 2.1 time: 0.310574 Jan 21 09:42:34.546339 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 519/1042] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Jan 21 09:42:34 2022] POST /compute/v2.1/servers/9c18953a-7af3-4d71-97ad-05eda7e34a73/action => generated 0 bytes in 314 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 21 09:42:34.557286 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-0547e81a-f787-41b2-90c6-23b00f7095ae tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:42:34.558073 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-0547e81a-f787-41b2-90c6-23b00f7095ae tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] [instance: 9c18953a-7af3-4d71-97ad-05eda7e34a73] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:42:34.566483 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-0547e81a-f787-41b2-90c6-23b00f7095ae tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:42:34.568629 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-0547e81a-f787-41b2-90c6-23b00f7095ae tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:42:34.568629 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-0547e81a-f787-41b2-90c6-23b00f7095ae tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:42:34.568629 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-0547e81a-f787-41b2-90c6-23b00f7095ae tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:42:34.581671 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-c1d2cd01-9407-404e-a5bd-68279d059a39 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:42:34.582627 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-c1d2cd01-9407-404e-a5bd-68279d059a39 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] [instance: e3dd8a17-5a2f-4f39-a110-208165e07110] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:42:34.599260 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-c1d2cd01-9407-404e-a5bd-68279d059a39 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:42:34.599914 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-c1d2cd01-9407-404e-a5bd-68279d059a39 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:42:34.601120 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-c1d2cd01-9407-404e-a5bd-68279d059a39 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:42:34.601788 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-c1d2cd01-9407-404e-a5bd-68279d059a39 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:42:34.959138 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-0547e81a-f787-41b2-90c6-23b00f7095ae tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '590e721135c84df5946147ac7e944fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2322cb784615409bb15a6f49522d3b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:42:34.976577 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-c1d2cd01-9407-404e-a5bd-68279d059a39 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:42:34.983710 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-0547e81a-f787-41b2-90c6-23b00f7095ae tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] 10.222.0.45 "GET /compute/v2.1/servers/9c18953a-7af3-4d71-97ad-05eda7e34a73" status: 200 len: 1666 microversion: 2.1 time: 0.420439 Jan 21 09:42:35.001199 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 524/1043] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:42:34 2022] GET /compute/v2.1/servers/9c18953a-7af3-4d71-97ad-05eda7e34a73 => generated 1666 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 09:42:35.001199 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-43bf3ef6-a9ee-4971-ab42-4164da3f1bfd tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:42:35.001838 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-c1d2cd01-9407-404e-a5bd-68279d059a39 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:42:35.001838 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-c1d2cd01-9407-404e-a5bd-68279d059a39 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:42:35.001838 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-c1d2cd01-9407-404e-a5bd-68279d059a39 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "GET /compute/v2.1/servers/e3dd8a17-5a2f-4f39-a110-208165e07110" status: 200 len: 1731 microversion: 2.20 time: 0.424514 Jan 21 09:42:35.012436 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-43bf3ef6-a9ee-4971-ab42-4164da3f1bfd tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] [instance: ef1ba7db-0bbf-44d8-ab58-f85d9194ecd6] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:42:35.015261 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 520/1044] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jan 21 09:42:34 2022] GET /compute/v2.1/servers/e3dd8a17-5a2f-4f39-a110-208165e07110 => generated 1731 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 21 09:42:35.021107 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-43bf3ef6-a9ee-4971-ab42-4164da3f1bfd tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:42:35.021679 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-43bf3ef6-a9ee-4971-ab42-4164da3f1bfd tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:42:35.022576 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-43bf3ef6-a9ee-4971-ab42-4164da3f1bfd tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:42:35.023028 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-43bf3ef6-a9ee-4971-ab42-4164da3f1bfd tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:42:35.388370 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-43bf3ef6-a9ee-4971-ab42-4164da3f1bfd tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d53a7fa2cb5498aa916817b82dba77e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515ded26ca114fbf9c6e920362aec64c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:42:35.398627 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-43bf3ef6-a9ee-4971-ab42-4164da3f1bfd tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] 10.222.0.45 "GET /compute/v2.1/servers/ef1ba7db-0bbf-44d8-ab58-f85d9194ecd6" status: 200 len: 1264 microversion: 2.1 time: 0.409137 Jan 21 09:42:35.399539 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 525/1045] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:42:34 2022] GET /compute/v2.1/servers/ef1ba7db-0bbf-44d8-ab58-f85d9194ecd6 => generated 1264 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:42:36.027625 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-c3c7f0c5-6244-4d96-b26b-d38fe67c5a57 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:42:36.028916 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-c3c7f0c5-6244-4d96-b26b-d38fe67c5a57 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] [instance: 9c18953a-7af3-4d71-97ad-05eda7e34a73] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:42:36.035717 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-ccab4042-7a55-467b-b9ed-c64c32096514 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:42:36.036990 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-ccab4042-7a55-467b-b9ed-c64c32096514 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] [instance: e3dd8a17-5a2f-4f39-a110-208165e07110] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:42:36.052308 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-c3c7f0c5-6244-4d96-b26b-d38fe67c5a57 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:42:36.053125 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-c3c7f0c5-6244-4d96-b26b-d38fe67c5a57 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:42:36.062617 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-ccab4042-7a55-467b-b9ed-c64c32096514 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:42:36.066264 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-c3c7f0c5-6244-4d96-b26b-d38fe67c5a57 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:42:36.067075 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-c3c7f0c5-6244-4d96-b26b-d38fe67c5a57 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:42:36.069600 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-ccab4042-7a55-467b-b9ed-c64c32096514 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:42:36.070421 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-ccab4042-7a55-467b-b9ed-c64c32096514 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:42:36.070881 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-ccab4042-7a55-467b-b9ed-c64c32096514 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:42:36.513415 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-ccab4042-7a55-467b-b9ed-c64c32096514 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:42:36.528323 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-ccab4042-7a55-467b-b9ed-c64c32096514 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:42:36.531275 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-ccab4042-7a55-467b-b9ed-c64c32096514 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:42:36.534604 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-ccab4042-7a55-467b-b9ed-c64c32096514 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "GET /compute/v2.1/servers/e3dd8a17-5a2f-4f39-a110-208165e07110" status: 200 len: 1731 microversion: 2.20 time: 0.518636 Jan 21 09:42:36.535538 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 526/1046] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jan 21 09:42:36 2022] GET /compute/v2.1/servers/e3dd8a17-5a2f-4f39-a110-208165e07110 => generated 1731 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 21 09:42:36.542383 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-c3c7f0c5-6244-4d96-b26b-d38fe67c5a57 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '590e721135c84df5946147ac7e944fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2322cb784615409bb15a6f49522d3b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:42:36.548270 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-ba9924fa-52d9-44bd-98d6-b68e8ccf691f tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:42:36.549461 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-ba9924fa-52d9-44bd-98d6-b68e8ccf691f tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] [instance: ef1ba7db-0bbf-44d8-ab58-f85d9194ecd6] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:42:36.557174 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-c3c7f0c5-6244-4d96-b26b-d38fe67c5a57 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] 10.222.0.45 "GET /compute/v2.1/servers/9c18953a-7af3-4d71-97ad-05eda7e34a73" status: 200 len: 1666 microversion: 2.1 time: 0.538684 Jan 21 09:42:36.557969 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 521/1047] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:42:36 2022] GET /compute/v2.1/servers/9c18953a-7af3-4d71-97ad-05eda7e34a73 => generated 1666 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:42:36.570281 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-ba9924fa-52d9-44bd-98d6-b68e8ccf691f tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:42:36.571600 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-ba9924fa-52d9-44bd-98d6-b68e8ccf691f tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:42:36.572550 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-ba9924fa-52d9-44bd-98d6-b68e8ccf691f tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:42:36.574227 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-ba9924fa-52d9-44bd-98d6-b68e8ccf691f tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:42:36.605510 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [req-ff1efd8b-ab62-4cca-89f6-3acd6f7a5d87 req-6de19ee1-a9c7-4fa1-8f70-7ef807f6599d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef1ba7db-0bbf-44d8-ab58-f85d9194ecd6", "name": "network-vif-plugged", "status": "completed", "tag": "23ca9b58-bb47-447e-9704-d2768396690b"}]} {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:42:36.607325 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 21 09:42:36.607325 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: warnings.warn(msg) Jan 21 09:42:36.620092 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [req-ff1efd8b-ab62-4cca-89f6-3acd6f7a5d87 req-6de19ee1-a9c7-4fa1-8f70-7ef807f6599d service nova] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:42:36.620690 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [req-ff1efd8b-ab62-4cca-89f6-3acd6f7a5d87 req-6de19ee1-a9c7-4fa1-8f70-7ef807f6599d service nova] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:42:36.637625 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.compute.server_external_events [req-ff1efd8b-ab62-4cca-89f6-3acd6f7a5d87 req-6de19ee1-a9c7-4fa1-8f70-7ef807f6599d service nova] Creating event network-vif-plugged:23ca9b58-bb47-447e-9704-d2768396690b for instance ef1ba7db-0bbf-44d8-ab58-f85d9194ecd6 on hv-cinder-80403 Jan 21 09:42:36.656679 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [req-ff1efd8b-ab62-4cca-89f6-3acd6f7a5d87 req-6de19ee1-a9c7-4fa1-8f70-7ef807f6599d service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050452 Jan 21 09:42:36.656679 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 522/1048] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Jan 21 09:42:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 21 09:42:36.799855 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-ba9924fa-52d9-44bd-98d6-b68e8ccf691f tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d53a7fa2cb5498aa916817b82dba77e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515ded26ca114fbf9c6e920362aec64c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:42:36.811187 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-ba9924fa-52d9-44bd-98d6-b68e8ccf691f tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] 10.222.0.45 "GET /compute/v2.1/servers/ef1ba7db-0bbf-44d8-ab58-f85d9194ecd6" status: 200 len: 1264 microversion: 2.1 time: 0.267061 Jan 21 09:42:36.812647 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 527/1049] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:42:36 2022] GET /compute/v2.1/servers/ef1ba7db-0bbf-44d8-ab58-f85d9194ecd6 => generated 1264 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:42:37.559081 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-1d7810a2-ddf4-40e8-b526-906fcf750ebe tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:42:37.559790 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-1d7810a2-ddf4-40e8-b526-906fcf750ebe tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] [instance: e3dd8a17-5a2f-4f39-a110-208165e07110] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:42:37.573311 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-1d7810a2-ddf4-40e8-b526-906fcf750ebe tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:42:37.573834 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-1d7810a2-ddf4-40e8-b526-906fcf750ebe tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:42:37.574673 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-1d7810a2-ddf4-40e8-b526-906fcf750ebe tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:42:37.575114 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-1d7810a2-ddf4-40e8-b526-906fcf750ebe tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:42:37.582255 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-7118aa4d-ad75-4739-aba0-7a2ba571b853 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:42:37.582952 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-7118aa4d-ad75-4739-aba0-7a2ba571b853 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] [instance: 9c18953a-7af3-4d71-97ad-05eda7e34a73] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:42:37.589819 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-7118aa4d-ad75-4739-aba0-7a2ba571b853 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:42:37.590306 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-7118aa4d-ad75-4739-aba0-7a2ba571b853 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:42:37.591299 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-7118aa4d-ad75-4739-aba0-7a2ba571b853 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:42:37.591748 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-7118aa4d-ad75-4739-aba0-7a2ba571b853 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:42:37.925497 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-7118aa4d-ad75-4739-aba0-7a2ba571b853 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '590e721135c84df5946147ac7e944fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2322cb784615409bb15a6f49522d3b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:42:37.933430 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-7118aa4d-ad75-4739-aba0-7a2ba571b853 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] 10.222.0.45 "GET /compute/v2.1/servers/9c18953a-7af3-4d71-97ad-05eda7e34a73" status: 200 len: 1670 microversion: 2.1 time: 0.357398 Jan 21 09:42:37.934391 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 528/1050] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:42:37 2022] GET /compute/v2.1/servers/9c18953a-7af3-4d71-97ad-05eda7e34a73 => generated 1670 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:42:37.935855 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-1d7810a2-ddf4-40e8-b526-906fcf750ebe tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:42:37.940215 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-29f33a49-ec9d-40e3-ac23-b4f036c659be tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:42:37.940841 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-29f33a49-ec9d-40e3-ac23-b4f036c659be tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] [instance: ef1ba7db-0bbf-44d8-ab58-f85d9194ecd6] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:42:37.945757 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-1d7810a2-ddf4-40e8-b526-906fcf750ebe tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:42:37.949406 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-29f33a49-ec9d-40e3-ac23-b4f036c659be tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:42:37.949665 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-1d7810a2-ddf4-40e8-b526-906fcf750ebe tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:42:37.949878 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-29f33a49-ec9d-40e3-ac23-b4f036c659be tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:42:37.950682 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-29f33a49-ec9d-40e3-ac23-b4f036c659be tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:42:37.951129 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-29f33a49-ec9d-40e3-ac23-b4f036c659be tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:42:37.951703 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-1d7810a2-ddf4-40e8-b526-906fcf750ebe tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "GET /compute/v2.1/servers/e3dd8a17-5a2f-4f39-a110-208165e07110" status: 200 len: 1731 microversion: 2.20 time: 0.397204 Jan 21 09:42:37.952827 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 523/1051] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jan 21 09:42:37 2022] GET /compute/v2.1/servers/e3dd8a17-5a2f-4f39-a110-208165e07110 => generated 1731 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 21 09:42:38.532977 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-29f33a49-ec9d-40e3-ac23-b4f036c659be tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d53a7fa2cb5498aa916817b82dba77e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515ded26ca114fbf9c6e920362aec64c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:42:38.546234 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-29f33a49-ec9d-40e3-ac23-b4f036c659be tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] 10.222.0.45 "GET /compute/v2.1/servers/ef1ba7db-0bbf-44d8-ab58-f85d9194ecd6" status: 200 len: 1264 microversion: 2.1 time: 0.610727 Jan 21 09:42:38.547321 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 529/1052] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:42:37 2022] GET /compute/v2.1/servers/ef1ba7db-0bbf-44d8-ab58-f85d9194ecd6 => generated 1264 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:42:38.673955 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [req-4023c058-151d-441f-a88e-7d4457c4bdea req-c09db633-cfb4-4e33-9040-eddd1bf04111 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3dd8a17-5a2f-4f39-a110-208165e07110", "name": "network-vif-plugged", "status": "completed", "tag": "248e29e3-d311-4074-bc03-c8c881428352"}]} {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:42:38.675724 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 21 09:42:38.675724 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: warnings.warn(msg) Jan 21 09:42:38.683748 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [req-4023c058-151d-441f-a88e-7d4457c4bdea req-c09db633-cfb4-4e33-9040-eddd1bf04111 service nova] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:42:38.684197 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [req-4023c058-151d-441f-a88e-7d4457c4bdea req-c09db633-cfb4-4e33-9040-eddd1bf04111 service nova] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:42:38.696794 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.compute.server_external_events [req-4023c058-151d-441f-a88e-7d4457c4bdea req-c09db633-cfb4-4e33-9040-eddd1bf04111 service nova] Creating event network-vif-plugged:248e29e3-d311-4074-bc03-c8c881428352 for instance e3dd8a17-5a2f-4f39-a110-208165e07110 on hv-cinder-80403 Jan 21 09:42:38.701972 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [req-4023c058-151d-441f-a88e-7d4457c4bdea req-c09db633-cfb4-4e33-9040-eddd1bf04111 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032541 Jan 21 09:42:38.702599 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 524/1053] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Jan 21 09:42:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 21 09:42:38.978085 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-33af9d8c-3d39-4abd-9aea-3b74d04fc971 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:42:38.979404 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-33af9d8c-3d39-4abd-9aea-3b74d04fc971 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] [instance: e3dd8a17-5a2f-4f39-a110-208165e07110] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:42:38.991817 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-33af9d8c-3d39-4abd-9aea-3b74d04fc971 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:42:38.992739 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-33af9d8c-3d39-4abd-9aea-3b74d04fc971 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:42:38.994305 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-33af9d8c-3d39-4abd-9aea-3b74d04fc971 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:42:38.995360 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-33af9d8c-3d39-4abd-9aea-3b74d04fc971 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:42:39.148895 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [req-76bb7a0f-0867-44df-8d0a-f991451bd602 req-6823cc6d-785a-4937-9c1e-da4995edbd86 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f4a4e6b7-47b1-4de2-8677-4f8e3eb056c2", "tag": "0e43678c-54de-414e-81b5-5773897a97f4"}]} {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:42:39.150705 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 21 09:42:39.150705 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: warnings.warn(msg) Jan 21 09:42:39.162933 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [req-76bb7a0f-0867-44df-8d0a-f991451bd602 req-6823cc6d-785a-4937-9c1e-da4995edbd86 service nova] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:42:39.166112 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [req-76bb7a0f-0867-44df-8d0a-f991451bd602 req-6823cc6d-785a-4937-9c1e-da4995edbd86 service nova] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:42:39.179607 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.compute.server_external_events [req-76bb7a0f-0867-44df-8d0a-f991451bd602 req-6823cc6d-785a-4937-9c1e-da4995edbd86 service nova] Creating event network-changed:0e43678c-54de-414e-81b5-5773897a97f4 for instance f4a4e6b7-47b1-4de2-8677-4f8e3eb056c2 on hv-cinder-80403 Jan 21 09:42:39.185397 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [req-76bb7a0f-0867-44df-8d0a-f991451bd602 req-6823cc6d-785a-4937-9c1e-da4995edbd86 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045420 Jan 21 09:42:39.186190 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 525/1054] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Jan 21 09:42:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 09:42:39.326181 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-33af9d8c-3d39-4abd-9aea-3b74d04fc971 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:42:39.342214 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-33af9d8c-3d39-4abd-9aea-3b74d04fc971 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:42:39.349795 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-33af9d8c-3d39-4abd-9aea-3b74d04fc971 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:42:39.349795 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-33af9d8c-3d39-4abd-9aea-3b74d04fc971 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "GET /compute/v2.1/servers/e3dd8a17-5a2f-4f39-a110-208165e07110" status: 200 len: 1731 microversion: 2.20 time: 0.377707 Jan 21 09:42:39.349795 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 530/1055] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jan 21 09:42:38 2022] GET /compute/v2.1/servers/e3dd8a17-5a2f-4f39-a110-208165e07110 => generated 1731 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 21 09:42:39.578011 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-38e83850-3499-45ab-bf42-9a506f8a3552 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:42:39.580079 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-38e83850-3499-45ab-bf42-9a506f8a3552 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] [instance: ef1ba7db-0bbf-44d8-ab58-f85d9194ecd6] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:42:39.590977 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-38e83850-3499-45ab-bf42-9a506f8a3552 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:42:39.598529 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-38e83850-3499-45ab-bf42-9a506f8a3552 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:42:39.598529 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-38e83850-3499-45ab-bf42-9a506f8a3552 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:42:39.598529 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-38e83850-3499-45ab-bf42-9a506f8a3552 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:42:39.862687 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-38e83850-3499-45ab-bf42-9a506f8a3552 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d53a7fa2cb5498aa916817b82dba77e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515ded26ca114fbf9c6e920362aec64c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:42:39.873297 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-38e83850-3499-45ab-bf42-9a506f8a3552 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] 10.222.0.45 "GET /compute/v2.1/servers/ef1ba7db-0bbf-44d8-ab58-f85d9194ecd6" status: 200 len: 1451 microversion: 2.1 time: 0.302089 Jan 21 09:42:39.874194 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 526/1056] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:42:39 2022] GET /compute/v2.1/servers/ef1ba7db-0bbf-44d8-ab58-f85d9194ecd6 => generated 1451 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:42:39.891072 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-3a3fa7c9-9e2f-4401-9685-9c7d38f07d67 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:42:39.892065 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-3a3fa7c9-9e2f-4401-9685-9c7d38f07d67 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] [instance: ef1ba7db-0bbf-44d8-ab58-f85d9194ecd6] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:42:39.899171 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-3a3fa7c9-9e2f-4401-9685-9c7d38f07d67 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:42:39.902024 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-3a3fa7c9-9e2f-4401-9685-9c7d38f07d67 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:42:39.903154 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-3a3fa7c9-9e2f-4401-9685-9c7d38f07d67 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:42:39.903670 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-3a3fa7c9-9e2f-4401-9685-9c7d38f07d67 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:42:40.178850 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-3a3fa7c9-9e2f-4401-9685-9c7d38f07d67 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d53a7fa2cb5498aa916817b82dba77e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515ded26ca114fbf9c6e920362aec64c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:42:40.195916 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-3a3fa7c9-9e2f-4401-9685-9c7d38f07d67 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] 10.222.0.45 "GET /compute/v2.1/servers/ef1ba7db-0bbf-44d8-ab58-f85d9194ecd6" status: 200 len: 1451 microversion: 2.1 time: 0.307813 Jan 21 09:42:40.199847 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 531/1057] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:42:39 2022] GET /compute/v2.1/servers/ef1ba7db-0bbf-44d8-ab58-f85d9194ecd6 => generated 1451 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:42:40.372670 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-7b55e2dc-4903-4c41-8106-28a44f2b005d tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:42:40.373965 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-7b55e2dc-4903-4c41-8106-28a44f2b005d tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] [instance: e3dd8a17-5a2f-4f39-a110-208165e07110] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:42:40.385915 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-7b55e2dc-4903-4c41-8106-28a44f2b005d tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:42:40.386861 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-7b55e2dc-4903-4c41-8106-28a44f2b005d tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:42:40.388475 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-7b55e2dc-4903-4c41-8106-28a44f2b005d tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:42:40.389403 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-7b55e2dc-4903-4c41-8106-28a44f2b005d tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:42:40.706734 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-7b55e2dc-4903-4c41-8106-28a44f2b005d tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:42:40.720092 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-7b55e2dc-4903-4c41-8106-28a44f2b005d tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:42:40.721696 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-7b55e2dc-4903-4c41-8106-28a44f2b005d tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:42:40.722941 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-7b55e2dc-4903-4c41-8106-28a44f2b005d tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "GET /compute/v2.1/servers/e3dd8a17-5a2f-4f39-a110-208165e07110" status: 200 len: 1731 microversion: 2.20 time: 0.359104 Jan 21 09:42:40.723526 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 527/1058] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jan 21 09:42:40 2022] GET /compute/v2.1/servers/e3dd8a17-5a2f-4f39-a110-208165e07110 => generated 1731 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 21 09:42:41.749182 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-97c571e1-7cee-412a-9cd4-5c339329510f tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:42:41.754269 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-97c571e1-7cee-412a-9cd4-5c339329510f tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] [instance: e3dd8a17-5a2f-4f39-a110-208165e07110] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:42:41.764355 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-97c571e1-7cee-412a-9cd4-5c339329510f tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:42:41.764810 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-97c571e1-7cee-412a-9cd4-5c339329510f tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:42:41.765678 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-97c571e1-7cee-412a-9cd4-5c339329510f tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:42:41.766119 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-97c571e1-7cee-412a-9cd4-5c339329510f tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:42:42.018370 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-97c571e1-7cee-412a-9cd4-5c339329510f tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:42:42.028462 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-97c571e1-7cee-412a-9cd4-5c339329510f tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:42:42.044601 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-97c571e1-7cee-412a-9cd4-5c339329510f tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:42:42.044601 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-97c571e1-7cee-412a-9cd4-5c339329510f tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "GET /compute/v2.1/servers/e3dd8a17-5a2f-4f39-a110-208165e07110" status: 200 len: 1731 microversion: 2.20 time: 0.292191 Jan 21 09:42:42.044601 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 532/1059] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jan 21 09:42:41 2022] GET /compute/v2.1/servers/e3dd8a17-5a2f-4f39-a110-208165e07110 => generated 1731 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 21 09:42:43.051808 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-bff3dda5-580b-4cab-a245-b6dd4b91c848 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:42:43.053169 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-bff3dda5-580b-4cab-a245-b6dd4b91c848 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] [instance: e3dd8a17-5a2f-4f39-a110-208165e07110] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:42:43.061251 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-bff3dda5-580b-4cab-a245-b6dd4b91c848 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:42:43.061768 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-bff3dda5-580b-4cab-a245-b6dd4b91c848 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:42:43.062620 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-bff3dda5-580b-4cab-a245-b6dd4b91c848 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:42:43.063272 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-bff3dda5-580b-4cab-a245-b6dd4b91c848 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:42:43.179025 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [req-dd1ff6be-9fab-4ce9-954f-7b34086145fb req-27bfb69a-48e3-4561-8b86-72e8b67726f1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ef1ba7db-0bbf-44d8-ab58-f85d9194ecd6", "tag": "23ca9b58-bb47-447e-9704-d2768396690b"}]} {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:42:43.182435 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 21 09:42:43.182435 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: warnings.warn(msg) Jan 21 09:42:43.192181 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [req-dd1ff6be-9fab-4ce9-954f-7b34086145fb req-27bfb69a-48e3-4561-8b86-72e8b67726f1 service nova] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:42:43.192796 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [req-dd1ff6be-9fab-4ce9-954f-7b34086145fb req-27bfb69a-48e3-4561-8b86-72e8b67726f1 service nova] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:42:43.208350 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.compute.server_external_events [req-dd1ff6be-9fab-4ce9-954f-7b34086145fb req-27bfb69a-48e3-4561-8b86-72e8b67726f1 service nova] Creating event network-changed:23ca9b58-bb47-447e-9704-d2768396690b for instance ef1ba7db-0bbf-44d8-ab58-f85d9194ecd6 on hv-cinder-80403 Jan 21 09:42:43.214003 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [req-dd1ff6be-9fab-4ce9-954f-7b34086145fb req-27bfb69a-48e3-4561-8b86-72e8b67726f1 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041047 Jan 21 09:42:43.215005 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 533/1060] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Jan 21 09:42:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 09:42:43.268421 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-bff3dda5-580b-4cab-a245-b6dd4b91c848 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:42:43.284890 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-bff3dda5-580b-4cab-a245-b6dd4b91c848 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:42:43.287306 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-bff3dda5-580b-4cab-a245-b6dd4b91c848 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:42:43.288739 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-bff3dda5-580b-4cab-a245-b6dd4b91c848 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "GET /compute/v2.1/servers/e3dd8a17-5a2f-4f39-a110-208165e07110" status: 200 len: 1718 microversion: 2.20 time: 0.241655 Jan 21 09:42:43.289614 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 528/1061] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jan 21 09:42:43 2022] GET /compute/v2.1/servers/e3dd8a17-5a2f-4f39-a110-208165e07110 => generated 1718 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jan 21 09:43:16.772186 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-426432d3-71d4-4f00-a598-96a6406a9ec6 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:43:16.773264 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-426432d3-71d4-4f00-a598-96a6406a9ec6 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] [instance: 9c18953a-7af3-4d71-97ad-05eda7e34a73] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:43:16.779543 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-426432d3-71d4-4f00-a598-96a6406a9ec6 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:43:16.779999 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-426432d3-71d4-4f00-a598-96a6406a9ec6 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:43:16.780799 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-426432d3-71d4-4f00-a598-96a6406a9ec6 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:43:16.781354 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-426432d3-71d4-4f00-a598-96a6406a9ec6 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:43:16.812224 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-426432d3-71d4-4f00-a598-96a6406a9ec6 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] 10.222.0.45 "GET /compute/v2.1/servers/9c18953a-7af3-4d71-97ad-05eda7e34a73/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045770 Jan 21 09:43:16.812787 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 534/1062] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Jan 21 09:43:16 2022] GET /compute/v2.1/servers/9c18953a-7af3-4d71-97ad-05eda7e34a73/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jan 21 09:43:16.875180 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-e4f6205f-65c7-46e4-a302-d10f55801cff tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:43:16.877070 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-e4f6205f-65c7-46e4-a302-d10f55801cff tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] [instance: 9c18953a-7af3-4d71-97ad-05eda7e34a73] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:43:16.884045 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-e4f6205f-65c7-46e4-a302-d10f55801cff tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:43:16.884542 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-e4f6205f-65c7-46e4-a302-d10f55801cff tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:43:16.885439 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-e4f6205f-65c7-46e4-a302-d10f55801cff tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:43:16.886054 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-e4f6205f-65c7-46e4-a302-d10f55801cff tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:43:16.919235 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-e4f6205f-65c7-46e4-a302-d10f55801cff tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] [instance: 9c18953a-7af3-4d71-97ad-05eda7e34a73] Going to try to terminate instance {{(pid=123386) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 21 09:43:17.272469 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-e4f6205f-65c7-46e4-a302-d10f55801cff tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] 10.222.0.45 "DELETE /compute/v2.1/servers/9c18953a-7af3-4d71-97ad-05eda7e34a73" status: 204 len: 0 microversion: 2.1 time: 0.402242 Jan 21 09:43:17.273531 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 529/1063] 10.222.0.45 () {58 vars in 1238 bytes} [Fri Jan 21 09:43:16 2022] DELETE /compute/v2.1/servers/9c18953a-7af3-4d71-97ad-05eda7e34a73 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jan 21 09:43:17.283557 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-764b1324-c71e-49a7-b12c-e2300529d758 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:43:17.284189 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-764b1324-c71e-49a7-b12c-e2300529d758 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] [instance: 9c18953a-7af3-4d71-97ad-05eda7e34a73] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:43:17.290700 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-764b1324-c71e-49a7-b12c-e2300529d758 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:43:17.295783 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-764b1324-c71e-49a7-b12c-e2300529d758 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:43:17.295783 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-764b1324-c71e-49a7-b12c-e2300529d758 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:43:17.295783 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-764b1324-c71e-49a7-b12c-e2300529d758 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:43:17.445419 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-764b1324-c71e-49a7-b12c-e2300529d758 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '590e721135c84df5946147ac7e944fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2322cb784615409bb15a6f49522d3b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:43:17.453075 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-764b1324-c71e-49a7-b12c-e2300529d758 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] 10.222.0.45 "GET /compute/v2.1/servers/9c18953a-7af3-4d71-97ad-05eda7e34a73" status: 200 len: 1676 microversion: 2.1 time: 0.174224 Jan 21 09:43:17.453703 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 535/1064] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:43:17 2022] GET /compute/v2.1/servers/9c18953a-7af3-4d71-97ad-05eda7e34a73 => generated 1676 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:43:18.472994 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-256b8f05-1ce9-43b2-8d60-3007ffdf0920 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:43:18.473774 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-256b8f05-1ce9-43b2-8d60-3007ffdf0920 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] [instance: 9c18953a-7af3-4d71-97ad-05eda7e34a73] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:43:18.480523 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-256b8f05-1ce9-43b2-8d60-3007ffdf0920 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:43:18.480990 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-256b8f05-1ce9-43b2-8d60-3007ffdf0920 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:43:18.481817 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-256b8f05-1ce9-43b2-8d60-3007ffdf0920 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:43:18.482253 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-256b8f05-1ce9-43b2-8d60-3007ffdf0920 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:43:18.643364 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-256b8f05-1ce9-43b2-8d60-3007ffdf0920 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '590e721135c84df5946147ac7e944fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2322cb784615409bb15a6f49522d3b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:43:18.656173 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-256b8f05-1ce9-43b2-8d60-3007ffdf0920 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] 10.222.0.45 "GET /compute/v2.1/servers/9c18953a-7af3-4d71-97ad-05eda7e34a73" status: 200 len: 1676 microversion: 2.1 time: 0.187022 Jan 21 09:43:18.657948 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 530/1065] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:43:18 2022] GET /compute/v2.1/servers/9c18953a-7af3-4d71-97ad-05eda7e34a73 => generated 1676 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:43:19.680368 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-8d3b5bc1-ab37-41d5-bf92-c454addd564d tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:43:19.681430 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-8d3b5bc1-ab37-41d5-bf92-c454addd564d tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] [instance: 9c18953a-7af3-4d71-97ad-05eda7e34a73] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:43:19.689449 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-8d3b5bc1-ab37-41d5-bf92-c454addd564d tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:43:19.689945 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-8d3b5bc1-ab37-41d5-bf92-c454addd564d tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:43:19.690780 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-8d3b5bc1-ab37-41d5-bf92-c454addd564d tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:43:19.691219 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-8d3b5bc1-ab37-41d5-bf92-c454addd564d tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:43:19.971498 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-8d3b5bc1-ab37-41d5-bf92-c454addd564d tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '590e721135c84df5946147ac7e944fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2322cb784615409bb15a6f49522d3b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:43:19.983140 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-8d3b5bc1-ab37-41d5-bf92-c454addd564d tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] 10.222.0.45 "GET /compute/v2.1/servers/9c18953a-7af3-4d71-97ad-05eda7e34a73" status: 200 len: 1676 microversion: 2.1 time: 0.306347 Jan 21 09:43:19.984290 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 536/1066] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:43:19 2022] GET /compute/v2.1/servers/9c18953a-7af3-4d71-97ad-05eda7e34a73 => generated 1676 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:43:20.612487 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [req-51372101-2ca6-4fe5-879d-accbb695faf6 req-c0a539d1-76cc-4937-9a87-cbd5381f7a01 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c18953a-7af3-4d71-97ad-05eda7e34a73", "name": "network-vif-deleted", "tag": "da26baff-2b3f-4d1c-9008-db890c2d77f2"}]} {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:43:20.614148 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 21 09:43:20.614148 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: warnings.warn(msg) Jan 21 09:43:20.621870 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [req-51372101-2ca6-4fe5-879d-accbb695faf6 req-c0a539d1-76cc-4937-9a87-cbd5381f7a01 service nova] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:43:20.631357 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [req-51372101-2ca6-4fe5-879d-accbb695faf6 req-c0a539d1-76cc-4937-9a87-cbd5381f7a01 service nova] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:43:20.640442 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.compute.server_external_events [req-51372101-2ca6-4fe5-879d-accbb695faf6 req-c0a539d1-76cc-4937-9a87-cbd5381f7a01 service nova] Creating event network-vif-deleted:da26baff-2b3f-4d1c-9008-db890c2d77f2 for instance 9c18953a-7af3-4d71-97ad-05eda7e34a73 on hv-cinder-80403 Jan 21 09:43:20.647495 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [req-51372101-2ca6-4fe5-879d-accbb695faf6 req-c0a539d1-76cc-4937-9a87-cbd5381f7a01 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039213 Jan 21 09:43:20.648097 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 531/1067] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Jan 21 09:43:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 09:43:21.006262 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-50cae0ba-431c-419f-b0a4-258bebf9b771 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:43:21.008943 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-50cae0ba-431c-419f-b0a4-258bebf9b771 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] [instance: 9c18953a-7af3-4d71-97ad-05eda7e34a73] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:43:21.014744 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-50cae0ba-431c-419f-b0a4-258bebf9b771 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:43:21.015237 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-50cae0ba-431c-419f-b0a4-258bebf9b771 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:43:21.017831 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-50cae0ba-431c-419f-b0a4-258bebf9b771 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:43:21.017831 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-50cae0ba-431c-419f-b0a4-258bebf9b771 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:43:21.051543 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-50cae0ba-431c-419f-b0a4-258bebf9b771 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:43:21.051994 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-50cae0ba-431c-419f-b0a4-258bebf9b771 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:43:21.052540 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.objects.instance [None req-50cae0ba-431c-419f-b0a4-258bebf9b771 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lazy-loading 'fault' on Instance uuid 9c18953a-7af3-4d71-97ad-05eda7e34a73 {{(pid=123387) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 21 09:43:21.102836 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-50cae0ba-431c-419f-b0a4-258bebf9b771 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '590e721135c84df5946147ac7e944fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2322cb784615409bb15a6f49522d3b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:43:21.116564 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-50cae0ba-431c-419f-b0a4-258bebf9b771 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] 10.222.0.45 "GET /compute/v2.1/servers/9c18953a-7af3-4d71-97ad-05eda7e34a73" status: 200 len: 1328 microversion: 2.1 time: 0.113491 Jan 21 09:43:21.117678 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 537/1068] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:43:21 2022] GET /compute/v2.1/servers/9c18953a-7af3-4d71-97ad-05eda7e34a73 => generated 1328 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:43:21.763069 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-35191d63-3bf0-4310-8062-38030855ab72 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:43:21.764080 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-35191d63-3bf0-4310-8062-38030855ab72 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] [instance: e3dd8a17-5a2f-4f39-a110-208165e07110] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:43:21.772601 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-35191d63-3bf0-4310-8062-38030855ab72 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:43:21.773175 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-35191d63-3bf0-4310-8062-38030855ab72 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:43:21.778978 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-35191d63-3bf0-4310-8062-38030855ab72 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:43:21.778978 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-35191d63-3bf0-4310-8062-38030855ab72 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:43:21.811865 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-35191d63-3bf0-4310-8062-38030855ab72 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "GET /compute/v2.1/servers/e3dd8a17-5a2f-4f39-a110-208165e07110/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.053188 Jan 21 09:43:21.812749 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 532/1069] 10.222.0.45 () {60 vars in 1342 bytes} [Fri Jan 21 09:43:21 2022] GET /compute/v2.1/servers/e3dd8a17-5a2f-4f39-a110-208165e07110/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:43:21.900415 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-2daad98d-fd70-4e44-ad24-bd5d20605d87 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:43:21.900949 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-2daad98d-fd70-4e44-ad24-bd5d20605d87 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] [instance: e3dd8a17-5a2f-4f39-a110-208165e07110] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:43:21.911519 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-2daad98d-fd70-4e44-ad24-bd5d20605d87 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:43:21.912301 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-2daad98d-fd70-4e44-ad24-bd5d20605d87 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:43:21.913791 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-2daad98d-fd70-4e44-ad24-bd5d20605d87 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:43:21.914710 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-2daad98d-fd70-4e44-ad24-bd5d20605d87 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:43:21.950590 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-2daad98d-fd70-4e44-ad24-bd5d20605d87 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] [instance: e3dd8a17-5a2f-4f39-a110-208165e07110] Going to try to terminate instance {{(pid=123387) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 21 09:43:22.144508 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-05bd0906-810b-4ac3-a108-b62f20a435e6 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:43:22.145135 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-05bd0906-810b-4ac3-a108-b62f20a435e6 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] [instance: 9c18953a-7af3-4d71-97ad-05eda7e34a73] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:43:22.151626 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-05bd0906-810b-4ac3-a108-b62f20a435e6 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:43:22.152099 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-05bd0906-810b-4ac3-a108-b62f20a435e6 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:43:22.152883 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-05bd0906-810b-4ac3-a108-b62f20a435e6 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:43:22.153363 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-05bd0906-810b-4ac3-a108-b62f20a435e6 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:43:22.173352 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.wsgi [None req-05bd0906-810b-4ac3-a108-b62f20a435e6 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] HTTP exception thrown: Instance 9c18953a-7af3-4d71-97ad-05eda7e34a73 could not be found. Jan 21 09:43:22.173352 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-05bd0906-810b-4ac3-a108-b62f20a435e6 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Returning 404 to user: Instance 9c18953a-7af3-4d71-97ad-05eda7e34a73 could not be found. {{(pid=123386) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 21 09:43:22.173352 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-05bd0906-810b-4ac3-a108-b62f20a435e6 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] 10.222.0.45 "GET /compute/v2.1/servers/9c18953a-7af3-4d71-97ad-05eda7e34a73" status: 404 len: 111 microversion: 2.1 time: 0.030624 Jan 21 09:43:22.173352 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 533/1070] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:43:22 2022] GET /compute/v2.1/servers/9c18953a-7af3-4d71-97ad-05eda7e34a73 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 21 09:43:22.181655 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-26bc5ab2-17bf-4d6a-bd65-a56e8980f0b6 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Calling method '.version_select at 0x7fb6c2c5c4c0>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:43:22.306102 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-26bc5ab2-17bf-4d6a-bd65-a56e8980f0b6 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1631447357" status: 202 len: 0 microversion: 2.1 time: 0.127984 Jan 21 09:43:22.306431 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-2daad98d-fd70-4e44-ad24-bd5d20605d87 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "DELETE /compute/v2.1/servers/e3dd8a17-5a2f-4f39-a110-208165e07110" status: 204 len: 0 microversion: 2.20 time: 0.408811 Jan 21 09:43:22.308235 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 534/1072] 10.222.0.45 () {58 vars in 1220 bytes} [Fri Jan 21 09:43:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1631447357 => generated 0 bytes in 131 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jan 21 09:43:22.316220 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 538/1072] 10.222.0.45 () {60 vars in 1279 bytes} [Fri Jan 21 09:43:21 2022] DELETE /compute/v2.1/servers/e3dd8a17-5a2f-4f39-a110-208165e07110 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jan 21 09:43:22.320995 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-41a035d4-3824-4afc-8047-e81100b4a419 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:43:22.322398 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-41a035d4-3824-4afc-8047-e81100b4a419 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] [instance: e3dd8a17-5a2f-4f39-a110-208165e07110] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:43:22.335152 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-41a035d4-3824-4afc-8047-e81100b4a419 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:43:22.336393 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-41a035d4-3824-4afc-8047-e81100b4a419 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:43:22.338216 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-41a035d4-3824-4afc-8047-e81100b4a419 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:43:22.339243 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-41a035d4-3824-4afc-8047-e81100b4a419 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:43:22.577370 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-41a035d4-3824-4afc-8047-e81100b4a419 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:43:22.586807 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-41a035d4-3824-4afc-8047-e81100b4a419 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:43:22.591064 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-41a035d4-3824-4afc-8047-e81100b4a419 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:43:22.591064 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-41a035d4-3824-4afc-8047-e81100b4a419 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "GET /compute/v2.1/servers/e3dd8a17-5a2f-4f39-a110-208165e07110" status: 200 len: 1724 microversion: 2.20 time: 0.277168 Jan 21 09:43:22.591064 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 535/1073] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jan 21 09:43:22 2022] GET /compute/v2.1/servers/e3dd8a17-5a2f-4f39-a110-208165e07110 => generated 1724 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 21 09:43:23.323664 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-0804522f-1300-4377-a8e6-cd85d54cfad3 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Action: 'create', calling method: .version_select at 0x7fb6c2b8edc0>, body: {"keypair": {"name": "tempest-keypair-532766766"}} {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:43:23.340559 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.quota [None req-0804522f-1300-4377-a8e6-cd85d54cfad3 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Getting quotas for project 2322cb784615409bb15a6f49522d3b34. Resources: {'key_pairs'} {{(pid=123387) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 21 09:43:23.346119 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.quota [None req-0804522f-1300-4377-a8e6-cd85d54cfad3 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Getting quotas for user 590e721135c84df5946147ac7e944fbc and project 2322cb784615409bb15a6f49522d3b34. Resources: {'key_pairs'} {{(pid=123387) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 21 09:43:23.611917 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-44cfdf43-62af-4705-8317-bfb7dcee50c5 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:43:23.614173 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-44cfdf43-62af-4705-8317-bfb7dcee50c5 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] [instance: e3dd8a17-5a2f-4f39-a110-208165e07110] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:43:23.625027 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-44cfdf43-62af-4705-8317-bfb7dcee50c5 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:43:23.626460 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-44cfdf43-62af-4705-8317-bfb7dcee50c5 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:43:23.628386 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-44cfdf43-62af-4705-8317-bfb7dcee50c5 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:43:23.629219 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-44cfdf43-62af-4705-8317-bfb7dcee50c5 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:43:23.638082 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.quota [None req-0804522f-1300-4377-a8e6-cd85d54cfad3 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Getting quotas for project 2322cb784615409bb15a6f49522d3b34. Resources: {'key_pairs'} {{(pid=123387) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 21 09:43:23.639762 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.quota [None req-0804522f-1300-4377-a8e6-cd85d54cfad3 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Getting quotas for user 590e721135c84df5946147ac7e944fbc and project 2322cb784615409bb15a6f49522d3b34. Resources: {'key_pairs'} {{(pid=123387) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 21 09:43:23.664036 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-0804522f-1300-4377-a8e6-cd85d54cfad3 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 2304 microversion: 2.1 time: 0.344425 Jan 21 09:43:23.665038 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 539/1074] 10.222.0.45 () {60 vars in 1157 bytes} [Fri Jan 21 09:43:23 2022] POST /compute/v2.1/os-keypairs => generated 2304 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:43:23.949276 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-44cfdf43-62af-4705-8317-bfb7dcee50c5 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:43:23.963350 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-44cfdf43-62af-4705-8317-bfb7dcee50c5 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:43:23.965817 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-44cfdf43-62af-4705-8317-bfb7dcee50c5 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:43:23.968429 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-44cfdf43-62af-4705-8317-bfb7dcee50c5 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "GET /compute/v2.1/servers/e3dd8a17-5a2f-4f39-a110-208165e07110" status: 200 len: 1724 microversion: 2.20 time: 0.362042 Jan 21 09:43:23.969782 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 536/1075] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jan 21 09:43:23 2022] GET /compute/v2.1/servers/e3dd8a17-5a2f-4f39-a110-208165e07110 => generated 1724 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 21 09:43:25.009606 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-91ebd474-4616-4852-8056-6f6f7a191446 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:43:25.011015 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-91ebd474-4616-4852-8056-6f6f7a191446 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] [instance: e3dd8a17-5a2f-4f39-a110-208165e07110] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:43:25.037112 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-91ebd474-4616-4852-8056-6f6f7a191446 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:43:25.037965 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-91ebd474-4616-4852-8056-6f6f7a191446 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:43:25.039507 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-91ebd474-4616-4852-8056-6f6f7a191446 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:43:25.040285 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-91ebd474-4616-4852-8056-6f6f7a191446 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:43:25.157780 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [req-655a74d4-f824-4ee5-b8b1-d7ee2736d764 req-bf4cce65-7748-43b4-8b73-e6f7a97cf737 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3dd8a17-5a2f-4f39-a110-208165e07110", "name": "network-vif-deleted", "tag": "248e29e3-d311-4074-bc03-c8c881428352"}]} {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:43:25.163578 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 21 09:43:25.163578 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: warnings.warn(msg) Jan 21 09:43:25.185508 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [req-655a74d4-f824-4ee5-b8b1-d7ee2736d764 req-bf4cce65-7748-43b4-8b73-e6f7a97cf737 service nova] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:43:25.186430 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [req-655a74d4-f824-4ee5-b8b1-d7ee2736d764 req-bf4cce65-7748-43b4-8b73-e6f7a97cf737 service nova] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:43:25.188591 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-91ebd474-4616-4852-8056-6f6f7a191446 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:43:25.197949 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-91ebd474-4616-4852-8056-6f6f7a191446 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:43:25.200068 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-91ebd474-4616-4852-8056-6f6f7a191446 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c190858354e14533a06a1fac88f2cfd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93281ac9cb504124a055279296f2262f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:43:25.201498 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-91ebd474-4616-4852-8056-6f6f7a191446 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "GET /compute/v2.1/servers/e3dd8a17-5a2f-4f39-a110-208165e07110" status: 200 len: 1657 microversion: 2.20 time: 0.209638 Jan 21 09:43:25.202819 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.compute.server_external_events [req-655a74d4-f824-4ee5-b8b1-d7ee2736d764 req-bf4cce65-7748-43b4-8b73-e6f7a97cf737 service nova] Creating event network-vif-deleted:248e29e3-d311-4074-bc03-c8c881428352 for instance e3dd8a17-5a2f-4f39-a110-208165e07110 on hv-cinder-80403 Jan 21 09:43:25.210320 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [req-655a74d4-f824-4ee5-b8b1-d7ee2736d764 req-bf4cce65-7748-43b4-8b73-e6f7a97cf737 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057645 Jan 21 09:43:25.211782 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 537/1076] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Jan 21 09:43:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 09:43:25.223232 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 540/1077] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jan 21 09:43:24 2022] GET /compute/v2.1/servers/e3dd8a17-5a2f-4f39-a110-208165e07110 => generated 1657 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jan 21 09:43:26.226157 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-51260b54-c24a-42a0-aeb1-67fdb3ff8b93 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:43:26.228411 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-51260b54-c24a-42a0-aeb1-67fdb3ff8b93 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] [instance: e3dd8a17-5a2f-4f39-a110-208165e07110] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:43:26.237556 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-51260b54-c24a-42a0-aeb1-67fdb3ff8b93 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:43:26.238158 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-51260b54-c24a-42a0-aeb1-67fdb3ff8b93 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:43:26.239087 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-51260b54-c24a-42a0-aeb1-67fdb3ff8b93 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:43:26.239589 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-51260b54-c24a-42a0-aeb1-67fdb3ff8b93 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:43:26.259767 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.wsgi [None req-51260b54-c24a-42a0-aeb1-67fdb3ff8b93 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] HTTP exception thrown: Instance e3dd8a17-5a2f-4f39-a110-208165e07110 could not be found. Jan 21 09:43:26.260577 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-51260b54-c24a-42a0-aeb1-67fdb3ff8b93 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Returning 404 to user: Instance e3dd8a17-5a2f-4f39-a110-208165e07110 could not be found. {{(pid=123386) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 21 09:43:26.261455 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-51260b54-c24a-42a0-aeb1-67fdb3ff8b93 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "GET /compute/v2.1/servers/e3dd8a17-5a2f-4f39-a110-208165e07110" status: 404 len: 111 microversion: 2.20 time: 0.041878 Jan 21 09:43:26.262363 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 538/1078] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jan 21 09:43:26 2022] GET /compute/v2.1/servers/e3dd8a17-5a2f-4f39-a110-208165e07110 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jan 21 09:43:26.271913 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-750322e2-fc4a-4403-9606-179a009a7093 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Calling method '.version_select at 0x7fb6c2ca8b80>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:43:26.398663 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-750322e2-fc4a-4403-9606-179a009a7093 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1032408331" status: 204 len: 0 microversion: 2.20 time: 0.131061 Jan 21 09:43:26.400047 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 541/1079] 10.222.0.45 () {60 vars in 1261 bytes} [Fri Jan 21 09:43:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1032408331 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jan 21 09:43:26.575400 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-7044be31-22bf-459b-bdf9-5a082c443aa2 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-91671904", "imageRef": "813e53ee-82e7-4a13-9f63-a8be7b1089f1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0dd36bcf-7b04-41a7-a991-1f81f12526d5"}], "security_groups": [{"name": "tempest-securitygroup--1637121993"}], "key_name": "tempest-keypair-532766766", "user_data": "}} {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:43:27.053057 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.network.neutron [None req-7044be31-22bf-459b-bdf9-5a082c443aa2 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] validate_networks() for [('0dd36bcf-7b04-41a7-a991-1f81f12526d5', None, None, None, None, None)] {{(pid=123386) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 21 09:43:27.742048 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.virt.hardware [None req-7044be31-22bf-459b-bdf9-5a082c443aa2 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Flavor limits 0:0:0 {{(pid=123386) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 21 09:43:27.743068 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.virt.hardware [None req-7044be31-22bf-459b-bdf9-5a082c443aa2 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Image limits 0:0:0 {{(pid=123386) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 21 09:43:27.743730 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.virt.hardware [None req-7044be31-22bf-459b-bdf9-5a082c443aa2 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Flavor pref 0:0:0 {{(pid=123386) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 21 09:43:27.744496 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.virt.hardware [None req-7044be31-22bf-459b-bdf9-5a082c443aa2 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Image pref 0:0:0 {{(pid=123386) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 21 09:43:27.745326 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.virt.hardware [None req-7044be31-22bf-459b-bdf9-5a082c443aa2 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123386) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 21 09:43:27.759995 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-7044be31-22bf-459b-bdf9-5a082c443aa2 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:43:27.760766 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-7044be31-22bf-459b-bdf9-5a082c443aa2 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:43:27.762282 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-7044be31-22bf-459b-bdf9-5a082c443aa2 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:43:27.763065 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-7044be31-22bf-459b-bdf9-5a082c443aa2 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:43:27.787852 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.quota [None req-7044be31-22bf-459b-bdf9-5a082c443aa2 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Getting quotas for project 2322cb784615409bb15a6f49522d3b34. Resources: {'cores', 'instances', 'ram'} {{(pid=123386) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 21 09:43:27.792075 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.quota [None req-7044be31-22bf-459b-bdf9-5a082c443aa2 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Getting quotas for user 590e721135c84df5946147ac7e944fbc and project 2322cb784615409bb15a6f49522d3b34. Resources: {'cores', 'instances', 'ram'} {{(pid=123386) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 21 09:43:27.804376 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-7044be31-22bf-459b-bdf9-5a082c443aa2 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Going to run 1 instances... {{(pid=123386) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 21 09:43:27.806901 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-7044be31-22bf-459b-bdf9-5a082c443aa2 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] [instance: daedf7bb-47ff-460d-bfb4-ac6166801f10] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='813e53ee-82e7-4a13-9f63-a8be7b1089f1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123386) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 21 09:43:27.921259 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-7044be31-22bf-459b-bdf9-5a082c443aa2 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.349590 Jan 21 09:43:27.931319 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 539/1080] 10.222.0.45 () {60 vars in 1146 bytes} [Fri Jan 21 09:43:26 2022] POST /compute/v2.1/servers => generated 402 bytes in 1361 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 21 09:43:27.936574 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-77a1303e-feb2-4dd4-b176-e61c07927572 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:43:27.938649 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-77a1303e-feb2-4dd4-b176-e61c07927572 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] [instance: daedf7bb-47ff-460d-bfb4-ac6166801f10] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:43:28.040554 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-77a1303e-feb2-4dd4-b176-e61c07927572 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '590e721135c84df5946147ac7e944fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2322cb784615409bb15a6f49522d3b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:43:28.055711 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-77a1303e-feb2-4dd4-b176-e61c07927572 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] 10.222.0.45 "GET /compute/v2.1/servers/daedf7bb-47ff-460d-bfb4-ac6166801f10" status: 200 len: 1235 microversion: 2.1 time: 0.120214 Jan 21 09:43:28.057350 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 542/1081] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:43:27 2022] GET /compute/v2.1/servers/daedf7bb-47ff-460d-bfb4-ac6166801f10 => generated 1235 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 09:43:29.075287 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-ef055512-6662-44f2-91c0-00f3f8901207 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:43:29.075905 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-ef055512-6662-44f2-91c0-00f3f8901207 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] [instance: daedf7bb-47ff-460d-bfb4-ac6166801f10] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:43:29.083492 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-ef055512-6662-44f2-91c0-00f3f8901207 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:43:29.083948 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-ef055512-6662-44f2-91c0-00f3f8901207 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:43:29.084750 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-ef055512-6662-44f2-91c0-00f3f8901207 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:43:29.085221 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-ef055512-6662-44f2-91c0-00f3f8901207 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:43:29.148742 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-ef055512-6662-44f2-91c0-00f3f8901207 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '590e721135c84df5946147ac7e944fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2322cb784615409bb15a6f49522d3b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:43:29.167057 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-ef055512-6662-44f2-91c0-00f3f8901207 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] 10.222.0.45 "GET /compute/v2.1/servers/daedf7bb-47ff-460d-bfb4-ac6166801f10" status: 200 len: 1239 microversion: 2.1 time: 0.095984 Jan 21 09:43:29.168986 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 540/1082] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:43:29 2022] GET /compute/v2.1/servers/daedf7bb-47ff-460d-bfb4-ac6166801f10 => generated 1239 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 09:43:29.294473 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-590f5885-21d2-4c75-b197-5ca8e6aa1838 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:43:29.295056 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-590f5885-21d2-4c75-b197-5ca8e6aa1838 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] [instance: e3dd8a17-5a2f-4f39-a110-208165e07110] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:43:29.302666 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-590f5885-21d2-4c75-b197-5ca8e6aa1838 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:43:29.303158 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-590f5885-21d2-4c75-b197-5ca8e6aa1838 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:43:29.303958 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-590f5885-21d2-4c75-b197-5ca8e6aa1838 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:43:29.304399 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-590f5885-21d2-4c75-b197-5ca8e6aa1838 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:43:29.319371 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.wsgi [None req-590f5885-21d2-4c75-b197-5ca8e6aa1838 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] HTTP exception thrown: Instance e3dd8a17-5a2f-4f39-a110-208165e07110 could not be found. Jan 21 09:43:29.320382 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-590f5885-21d2-4c75-b197-5ca8e6aa1838 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Returning 404 to user: Instance e3dd8a17-5a2f-4f39-a110-208165e07110 could not be found. {{(pid=123387) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 21 09:43:29.321908 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-590f5885-21d2-4c75-b197-5ca8e6aa1838 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "DELETE /compute/v2.1/servers/e3dd8a17-5a2f-4f39-a110-208165e07110" status: 404 len: 111 microversion: 2.20 time: 0.031167 Jan 21 09:43:29.322740 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 543/1083] 10.222.0.45 () {60 vars in 1279 bytes} [Fri Jan 21 09:43:29 2022] DELETE /compute/v2.1/servers/e3dd8a17-5a2f-4f39-a110-208165e07110 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jan 21 09:43:29.331199 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-41810313-c85c-4643-86ce-249408feab97 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:43:29.332314 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-41810313-c85c-4643-86ce-249408feab97 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] [instance: e3dd8a17-5a2f-4f39-a110-208165e07110] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:43:29.340331 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-41810313-c85c-4643-86ce-249408feab97 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:43:29.340879 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-41810313-c85c-4643-86ce-249408feab97 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:43:29.341803 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-41810313-c85c-4643-86ce-249408feab97 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:43:29.342317 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-41810313-c85c-4643-86ce-249408feab97 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:43:29.357809 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.wsgi [None req-41810313-c85c-4643-86ce-249408feab97 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] HTTP exception thrown: Instance e3dd8a17-5a2f-4f39-a110-208165e07110 could not be found. Jan 21 09:43:29.358669 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-41810313-c85c-4643-86ce-249408feab97 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Returning 404 to user: Instance e3dd8a17-5a2f-4f39-a110-208165e07110 could not be found. {{(pid=123386) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 21 09:43:29.359561 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-41810313-c85c-4643-86ce-249408feab97 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "GET /compute/v2.1/servers/e3dd8a17-5a2f-4f39-a110-208165e07110" status: 404 len: 111 microversion: 2.20 time: 0.032562 Jan 21 09:43:29.360765 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 541/1084] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jan 21 09:43:29 2022] GET /compute/v2.1/servers/e3dd8a17-5a2f-4f39-a110-208165e07110 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jan 21 09:43:30.193168 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-9171c7c7-fcc8-4720-8277-556b60b37260 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:43:30.193813 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-9171c7c7-fcc8-4720-8277-556b60b37260 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] [instance: daedf7bb-47ff-460d-bfb4-ac6166801f10] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:43:30.201407 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-9171c7c7-fcc8-4720-8277-556b60b37260 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:43:30.201795 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-9171c7c7-fcc8-4720-8277-556b60b37260 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:43:30.202857 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-9171c7c7-fcc8-4720-8277-556b60b37260 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:43:30.203550 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-9171c7c7-fcc8-4720-8277-556b60b37260 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:43:30.319746 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-9171c7c7-fcc8-4720-8277-556b60b37260 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '590e721135c84df5946147ac7e944fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2322cb784615409bb15a6f49522d3b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:43:30.333410 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-9171c7c7-fcc8-4720-8277-556b60b37260 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] 10.222.0.45 "GET /compute/v2.1/servers/daedf7bb-47ff-460d-bfb4-ac6166801f10" status: 200 len: 1295 microversion: 2.1 time: 0.144521 Jan 21 09:43:30.334214 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 544/1085] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:43:30 2022] GET /compute/v2.1/servers/daedf7bb-47ff-460d-bfb4-ac6166801f10 => generated 1295 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:43:30.743933 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-6a0d33d1-842e-49cb-92aa-7b0c75d37e81 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:43:30.746550 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-6a0d33d1-842e-49cb-92aa-7b0c75d37e81 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] [instance: 59ad64a5-af93-44ef-8031-fd2f2d18a901] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:43:30.759646 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-6a0d33d1-842e-49cb-92aa-7b0c75d37e81 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:43:30.760786 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-6a0d33d1-842e-49cb-92aa-7b0c75d37e81 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:43:30.762369 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-6a0d33d1-842e-49cb-92aa-7b0c75d37e81 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:43:30.763513 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-6a0d33d1-842e-49cb-92aa-7b0c75d37e81 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:43:30.791160 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.wsgi [None req-6a0d33d1-842e-49cb-92aa-7b0c75d37e81 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] HTTP exception thrown: Instance 59ad64a5-af93-44ef-8031-fd2f2d18a901 could not be found. Jan 21 09:43:30.792290 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-6a0d33d1-842e-49cb-92aa-7b0c75d37e81 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Returning 404 to user: Instance 59ad64a5-af93-44ef-8031-fd2f2d18a901 could not be found. {{(pid=123386) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 21 09:43:30.794023 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-6a0d33d1-842e-49cb-92aa-7b0c75d37e81 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "DELETE /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901" status: 404 len: 111 microversion: 2.20 time: 0.057745 Jan 21 09:43:30.795036 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 542/1086] 10.222.0.45 () {60 vars in 1279 bytes} [Fri Jan 21 09:43:30 2022] DELETE /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jan 21 09:43:30.805913 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-928c2e58-d736-40eb-8c69-e75374bdbd67 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:43:30.806548 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-928c2e58-d736-40eb-8c69-e75374bdbd67 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] [instance: 59ad64a5-af93-44ef-8031-fd2f2d18a901] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:43:30.813095 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-928c2e58-d736-40eb-8c69-e75374bdbd67 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:43:30.814534 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-928c2e58-d736-40eb-8c69-e75374bdbd67 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:43:30.815577 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-928c2e58-d736-40eb-8c69-e75374bdbd67 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:43:30.816192 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-928c2e58-d736-40eb-8c69-e75374bdbd67 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:43:30.839756 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.wsgi [None req-928c2e58-d736-40eb-8c69-e75374bdbd67 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] HTTP exception thrown: Instance 59ad64a5-af93-44ef-8031-fd2f2d18a901 could not be found. Jan 21 09:43:30.843046 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-928c2e58-d736-40eb-8c69-e75374bdbd67 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] Returning 404 to user: Instance 59ad64a5-af93-44ef-8031-fd2f2d18a901 could not be found. {{(pid=123387) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 21 09:43:30.843046 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-928c2e58-d736-40eb-8c69-e75374bdbd67 tempest-AttachVolumeShelveTestJSON-1553335206 tempest-AttachVolumeShelveTestJSON-1553335206-project] 10.222.0.45 "GET /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901" status: 404 len: 111 microversion: 2.20 time: 0.040649 Jan 21 09:43:30.845393 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 545/1087] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jan 21 09:43:30 2022] GET /compute/v2.1/servers/59ad64a5-af93-44ef-8031-fd2f2d18a901 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jan 21 09:43:31.362290 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-b61da0ba-2e88-4ada-83d3-8b1b7c439b6d tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:43:31.364729 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-b61da0ba-2e88-4ada-83d3-8b1b7c439b6d tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] [instance: daedf7bb-47ff-460d-bfb4-ac6166801f10] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:43:31.380347 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-b61da0ba-2e88-4ada-83d3-8b1b7c439b6d tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:43:31.387254 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-b61da0ba-2e88-4ada-83d3-8b1b7c439b6d tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:43:31.387254 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-b61da0ba-2e88-4ada-83d3-8b1b7c439b6d tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:43:31.387254 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-b61da0ba-2e88-4ada-83d3-8b1b7c439b6d tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:43:31.810887 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-b61da0ba-2e88-4ada-83d3-8b1b7c439b6d tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '590e721135c84df5946147ac7e944fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2322cb784615409bb15a6f49522d3b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:43:31.825604 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-b61da0ba-2e88-4ada-83d3-8b1b7c439b6d tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] 10.222.0.45 "GET /compute/v2.1/servers/daedf7bb-47ff-460d-bfb4-ac6166801f10" status: 200 len: 1361 microversion: 2.1 time: 0.474895 Jan 21 09:43:31.826517 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 543/1088] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:43:31 2022] GET /compute/v2.1/servers/daedf7bb-47ff-460d-bfb4-ac6166801f10 => generated 1361 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:43:32.708526 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [req-bd5539cc-752e-44dc-aa30-f18810d2560a req-ec83242d-735b-4c5b-8cef-10649cf4e88c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "daedf7bb-47ff-460d-bfb4-ac6166801f10", "tag": "20b2b8f5-45f6-4e4c-a61f-1787996fea63"}]} {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:43:32.716433 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 21 09:43:32.716433 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: warnings.warn(msg) Jan 21 09:43:32.737391 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [req-bd5539cc-752e-44dc-aa30-f18810d2560a req-ec83242d-735b-4c5b-8cef-10649cf4e88c service nova] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:43:32.738414 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [req-bd5539cc-752e-44dc-aa30-f18810d2560a req-ec83242d-735b-4c5b-8cef-10649cf4e88c service nova] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:43:32.756630 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.compute.server_external_events [req-bd5539cc-752e-44dc-aa30-f18810d2560a req-ec83242d-735b-4c5b-8cef-10649cf4e88c service nova] Creating event network-changed:20b2b8f5-45f6-4e4c-a61f-1787996fea63 for instance daedf7bb-47ff-460d-bfb4-ac6166801f10 on hv-cinder-80403 Jan 21 09:43:32.762569 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [req-bd5539cc-752e-44dc-aa30-f18810d2560a req-ec83242d-735b-4c5b-8cef-10649cf4e88c service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062447 Jan 21 09:43:32.763597 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 546/1089] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Jan 21 09:43:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 09:43:32.846942 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-ac33adf1-942f-4f19-b6f4-4234a8906a8a tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:43:32.847624 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-ac33adf1-942f-4f19-b6f4-4234a8906a8a tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] [instance: daedf7bb-47ff-460d-bfb4-ac6166801f10] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:43:32.854795 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-ac33adf1-942f-4f19-b6f4-4234a8906a8a tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:43:32.855367 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-ac33adf1-942f-4f19-b6f4-4234a8906a8a tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:43:32.856627 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-ac33adf1-942f-4f19-b6f4-4234a8906a8a tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:43:32.857656 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-ac33adf1-942f-4f19-b6f4-4234a8906a8a tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:43:33.175283 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-ac33adf1-942f-4f19-b6f4-4234a8906a8a tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '590e721135c84df5946147ac7e944fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2322cb784615409bb15a6f49522d3b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:43:33.187548 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-ac33adf1-942f-4f19-b6f4-4234a8906a8a tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] 10.222.0.45 "GET /compute/v2.1/servers/daedf7bb-47ff-460d-bfb4-ac6166801f10" status: 200 len: 1361 microversion: 2.1 time: 0.345365 Jan 21 09:43:33.190183 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 544/1090] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:43:32 2022] GET /compute/v2.1/servers/daedf7bb-47ff-460d-bfb4-ac6166801f10 => generated 1361 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:43:34.212842 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-96990a77-b99c-4e26-a0e3-6ef4d723339f tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:43:34.214163 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-96990a77-b99c-4e26-a0e3-6ef4d723339f tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] [instance: daedf7bb-47ff-460d-bfb4-ac6166801f10] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:43:34.222406 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-96990a77-b99c-4e26-a0e3-6ef4d723339f tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:43:34.222897 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-96990a77-b99c-4e26-a0e3-6ef4d723339f tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:43:34.223709 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-96990a77-b99c-4e26-a0e3-6ef4d723339f tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:43:34.224157 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-96990a77-b99c-4e26-a0e3-6ef4d723339f tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:43:34.397440 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-96990a77-b99c-4e26-a0e3-6ef4d723339f tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '590e721135c84df5946147ac7e944fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2322cb784615409bb15a6f49522d3b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:43:34.406436 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-96990a77-b99c-4e26-a0e3-6ef4d723339f tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] 10.222.0.45 "GET /compute/v2.1/servers/daedf7bb-47ff-460d-bfb4-ac6166801f10" status: 200 len: 1361 microversion: 2.1 time: 0.203020 Jan 21 09:43:34.407747 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 547/1091] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:43:34 2022] GET /compute/v2.1/servers/daedf7bb-47ff-460d-bfb4-ac6166801f10 => generated 1361 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:43:35.439215 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-a2472b68-7b80-423f-9124-d8c0c708cb31 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:43:35.440351 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-a2472b68-7b80-423f-9124-d8c0c708cb31 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] [instance: daedf7bb-47ff-460d-bfb4-ac6166801f10] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:43:35.456994 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-a2472b68-7b80-423f-9124-d8c0c708cb31 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:43:35.456994 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-a2472b68-7b80-423f-9124-d8c0c708cb31 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:43:35.457389 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-a2472b68-7b80-423f-9124-d8c0c708cb31 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:43:35.458685 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-a2472b68-7b80-423f-9124-d8c0c708cb31 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:43:35.620654 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-a2472b68-7b80-423f-9124-d8c0c708cb31 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '590e721135c84df5946147ac7e944fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2322cb784615409bb15a6f49522d3b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:43:35.628741 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-a2472b68-7b80-423f-9124-d8c0c708cb31 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] 10.222.0.45 "GET /compute/v2.1/servers/daedf7bb-47ff-460d-bfb4-ac6166801f10" status: 200 len: 1361 microversion: 2.1 time: 0.206146 Jan 21 09:43:35.629410 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 545/1092] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:43:35 2022] GET /compute/v2.1/servers/daedf7bb-47ff-460d-bfb4-ac6166801f10 => generated 1361 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:43:36.646933 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-c0135aca-d6be-4f6d-8cfb-444baea74915 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:43:36.647704 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-c0135aca-d6be-4f6d-8cfb-444baea74915 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] [instance: daedf7bb-47ff-460d-bfb4-ac6166801f10] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:43:36.654822 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-c0135aca-d6be-4f6d-8cfb-444baea74915 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:43:36.655268 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-c0135aca-d6be-4f6d-8cfb-444baea74915 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:43:36.656072 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-c0135aca-d6be-4f6d-8cfb-444baea74915 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:43:36.656507 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-c0135aca-d6be-4f6d-8cfb-444baea74915 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:43:36.825130 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-c0135aca-d6be-4f6d-8cfb-444baea74915 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '590e721135c84df5946147ac7e944fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2322cb784615409bb15a6f49522d3b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:43:36.839254 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-c0135aca-d6be-4f6d-8cfb-444baea74915 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] 10.222.0.45 "GET /compute/v2.1/servers/daedf7bb-47ff-460d-bfb4-ac6166801f10" status: 200 len: 1361 microversion: 2.1 time: 0.196184 Jan 21 09:43:36.840314 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 548/1093] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:43:36 2022] GET /compute/v2.1/servers/daedf7bb-47ff-460d-bfb4-ac6166801f10 => generated 1361 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:43:37.858067 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-94a23a3c-aa89-42dd-b1b4-b971eb56e233 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:43:37.858939 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-94a23a3c-aa89-42dd-b1b4-b971eb56e233 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] [instance: daedf7bb-47ff-460d-bfb4-ac6166801f10] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:43:37.866659 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-94a23a3c-aa89-42dd-b1b4-b971eb56e233 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:43:37.866953 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-94a23a3c-aa89-42dd-b1b4-b971eb56e233 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:43:37.867934 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-94a23a3c-aa89-42dd-b1b4-b971eb56e233 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:43:37.868191 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-94a23a3c-aa89-42dd-b1b4-b971eb56e233 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:43:38.034304 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-94a23a3c-aa89-42dd-b1b4-b971eb56e233 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '590e721135c84df5946147ac7e944fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2322cb784615409bb15a6f49522d3b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:43:38.042301 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-94a23a3c-aa89-42dd-b1b4-b971eb56e233 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] 10.222.0.45 "GET /compute/v2.1/servers/daedf7bb-47ff-460d-bfb4-ac6166801f10" status: 200 len: 1361 microversion: 2.1 time: 0.187844 Jan 21 09:43:38.042881 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 546/1094] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:43:37 2022] GET /compute/v2.1/servers/daedf7bb-47ff-460d-bfb4-ac6166801f10 => generated 1361 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:43:38.626974 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [req-7d31c5fb-3ed7-4e1a-8d25-cb75a991120c req-225b0a4c-d62c-4092-8b85-f9f145254352 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "daedf7bb-47ff-460d-bfb4-ac6166801f10", "name": "network-vif-plugged", "status": "completed", "tag": "20b2b8f5-45f6-4e4c-a61f-1787996fea63"}]} {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:43:38.630182 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 21 09:43:38.630182 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: warnings.warn(msg) Jan 21 09:43:38.648684 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [req-7d31c5fb-3ed7-4e1a-8d25-cb75a991120c req-225b0a4c-d62c-4092-8b85-f9f145254352 service nova] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:43:38.649110 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [req-7d31c5fb-3ed7-4e1a-8d25-cb75a991120c req-225b0a4c-d62c-4092-8b85-f9f145254352 service nova] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:43:38.672665 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.compute.server_external_events [req-7d31c5fb-3ed7-4e1a-8d25-cb75a991120c req-225b0a4c-d62c-4092-8b85-f9f145254352 service nova] Creating event network-vif-plugged:20b2b8f5-45f6-4e4c-a61f-1787996fea63 for instance daedf7bb-47ff-460d-bfb4-ac6166801f10 on hv-cinder-80403 Jan 21 09:43:38.679537 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [req-7d31c5fb-3ed7-4e1a-8d25-cb75a991120c req-225b0a4c-d62c-4092-8b85-f9f145254352 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057048 Jan 21 09:43:38.680531 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 549/1095] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Jan 21 09:43:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 09:43:39.064579 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-1671fdfc-cc8c-49d0-9d1d-e659af2958b0 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:43:39.066826 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-1671fdfc-cc8c-49d0-9d1d-e659af2958b0 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] [instance: daedf7bb-47ff-460d-bfb4-ac6166801f10] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:43:39.084929 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-1671fdfc-cc8c-49d0-9d1d-e659af2958b0 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:43:39.085851 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-1671fdfc-cc8c-49d0-9d1d-e659af2958b0 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:43:39.087271 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-1671fdfc-cc8c-49d0-9d1d-e659af2958b0 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:43:39.088053 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-1671fdfc-cc8c-49d0-9d1d-e659af2958b0 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:43:39.264363 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-1671fdfc-cc8c-49d0-9d1d-e659af2958b0 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '590e721135c84df5946147ac7e944fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2322cb784615409bb15a6f49522d3b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:43:39.273538 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-1671fdfc-cc8c-49d0-9d1d-e659af2958b0 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] 10.222.0.45 "GET /compute/v2.1/servers/daedf7bb-47ff-460d-bfb4-ac6166801f10" status: 200 len: 1361 microversion: 2.1 time: 0.216947 Jan 21 09:43:39.274203 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 547/1096] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:43:39 2022] GET /compute/v2.1/servers/daedf7bb-47ff-460d-bfb4-ac6166801f10 => generated 1361 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 09:43:40.293721 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-7ac8e984-af53-4f1d-98e5-bc0c9054c6d8 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:43:40.294935 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-7ac8e984-af53-4f1d-98e5-bc0c9054c6d8 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] [instance: daedf7bb-47ff-460d-bfb4-ac6166801f10] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:43:40.304728 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-7ac8e984-af53-4f1d-98e5-bc0c9054c6d8 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:43:40.305330 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-7ac8e984-af53-4f1d-98e5-bc0c9054c6d8 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:43:40.306219 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-7ac8e984-af53-4f1d-98e5-bc0c9054c6d8 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:43:40.306724 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-7ac8e984-af53-4f1d-98e5-bc0c9054c6d8 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:43:40.461407 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-7ac8e984-af53-4f1d-98e5-bc0c9054c6d8 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '590e721135c84df5946147ac7e944fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2322cb784615409bb15a6f49522d3b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:43:40.469906 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-7ac8e984-af53-4f1d-98e5-bc0c9054c6d8 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] 10.222.0.45 "GET /compute/v2.1/servers/daedf7bb-47ff-460d-bfb4-ac6166801f10" status: 200 len: 1361 microversion: 2.1 time: 0.181302 Jan 21 09:43:40.470367 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 550/1097] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:43:40 2022] GET /compute/v2.1/servers/daedf7bb-47ff-460d-bfb4-ac6166801f10 => generated 1361 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:43:41.491434 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-3d08ebc8-7ba8-41a6-9ee7-145a6337be49 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:43:41.492616 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-3d08ebc8-7ba8-41a6-9ee7-145a6337be49 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] [instance: daedf7bb-47ff-460d-bfb4-ac6166801f10] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:43:41.503705 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-3d08ebc8-7ba8-41a6-9ee7-145a6337be49 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:43:41.504169 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-3d08ebc8-7ba8-41a6-9ee7-145a6337be49 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:43:41.505346 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-3d08ebc8-7ba8-41a6-9ee7-145a6337be49 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:43:41.505786 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-3d08ebc8-7ba8-41a6-9ee7-145a6337be49 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:43:41.659723 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-3d08ebc8-7ba8-41a6-9ee7-145a6337be49 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '590e721135c84df5946147ac7e944fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2322cb784615409bb15a6f49522d3b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:43:41.667856 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-3d08ebc8-7ba8-41a6-9ee7-145a6337be49 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] 10.222.0.45 "GET /compute/v2.1/servers/daedf7bb-47ff-460d-bfb4-ac6166801f10" status: 200 len: 1547 microversion: 2.1 time: 0.183518 Jan 21 09:43:41.668535 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 548/1098] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:43:41 2022] GET /compute/v2.1/servers/daedf7bb-47ff-460d-bfb4-ac6166801f10 => generated 1547 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:43:41.689981 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-d7c9a90d-fb51-48f8-8c84-aeb80cb99cb9 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:43:41.691010 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-d7c9a90d-fb51-48f8-8c84-aeb80cb99cb9 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] [instance: daedf7bb-47ff-460d-bfb4-ac6166801f10] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:43:41.696923 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-d7c9a90d-fb51-48f8-8c84-aeb80cb99cb9 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:43:41.697369 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-d7c9a90d-fb51-48f8-8c84-aeb80cb99cb9 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:43:41.698154 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-d7c9a90d-fb51-48f8-8c84-aeb80cb99cb9 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:43:41.698585 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-d7c9a90d-fb51-48f8-8c84-aeb80cb99cb9 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:43:41.801685 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-d7c9a90d-fb51-48f8-8c84-aeb80cb99cb9 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] 10.222.0.45 "GET /compute/v2.1/servers/daedf7bb-47ff-460d-bfb4-ac6166801f10/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.115773 Jan 21 09:43:41.802294 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 551/1099] 10.222.0.45 () {58 vars in 1274 bytes} [Fri Jan 21 09:43:41 2022] GET /compute/v2.1/servers/daedf7bb-47ff-460d-bfb4-ac6166801f10/os-interface => generated 284 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 09:43:43.298028 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [req-86dda70a-a1fe-4592-8764-83a2fcff1387 req-941690cb-8af1-4455-b82e-dc35dfcaae45 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "daedf7bb-47ff-460d-bfb4-ac6166801f10", "tag": "20b2b8f5-45f6-4e4c-a61f-1787996fea63"}]} {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:43:43.299653 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 21 09:43:43.299653 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: warnings.warn(msg) Jan 21 09:43:43.301479 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-44edf247-f8d1-49d7-96b4-37bd22b17083 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:43:43.302603 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-44edf247-f8d1-49d7-96b4-37bd22b17083 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] [instance: daedf7bb-47ff-460d-bfb4-ac6166801f10] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:43:43.313450 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [req-86dda70a-a1fe-4592-8764-83a2fcff1387 req-941690cb-8af1-4455-b82e-dc35dfcaae45 service nova] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:43:43.314008 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [req-86dda70a-a1fe-4592-8764-83a2fcff1387 req-941690cb-8af1-4455-b82e-dc35dfcaae45 service nova] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:43:43.319967 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-44edf247-f8d1-49d7-96b4-37bd22b17083 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:43:43.319967 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-44edf247-f8d1-49d7-96b4-37bd22b17083 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:43:43.320792 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-44edf247-f8d1-49d7-96b4-37bd22b17083 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:43:43.321260 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-44edf247-f8d1-49d7-96b4-37bd22b17083 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:43:43.342515 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.compute.server_external_events [req-86dda70a-a1fe-4592-8764-83a2fcff1387 req-941690cb-8af1-4455-b82e-dc35dfcaae45 service nova] Creating event network-changed:20b2b8f5-45f6-4e4c-a61f-1787996fea63 for instance daedf7bb-47ff-460d-bfb4-ac6166801f10 on hv-cinder-80403 Jan 21 09:43:43.351373 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [req-86dda70a-a1fe-4592-8764-83a2fcff1387 req-941690cb-8af1-4455-b82e-dc35dfcaae45 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057923 Jan 21 09:43:43.354797 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 552/1100] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Jan 21 09:43:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 21 09:43:43.398451 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-44edf247-f8d1-49d7-96b4-37bd22b17083 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] 10.222.0.45 "POST /compute/v2.1/servers/daedf7bb-47ff-460d-bfb4-ac6166801f10/action" status: 200 len: 14 microversion: 2.1 time: 0.110593 Jan 21 09:43:43.404149 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 549/1101] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Jan 21 09:43:43 2022] POST /compute/v2.1/servers/daedf7bb-47ff-460d-bfb4-ac6166801f10/action => generated 14 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jan 21 09:43:44.412610 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-2d3471be-b924-48d5-9a84-c6dca6f8eb5f tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:43:44.413765 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-2d3471be-b924-48d5-9a84-c6dca6f8eb5f tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] [instance: daedf7bb-47ff-460d-bfb4-ac6166801f10] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:43:44.420940 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-2d3471be-b924-48d5-9a84-c6dca6f8eb5f tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:43:44.421429 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-2d3471be-b924-48d5-9a84-c6dca6f8eb5f tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:43:44.422593 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-2d3471be-b924-48d5-9a84-c6dca6f8eb5f tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:43:44.423218 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-2d3471be-b924-48d5-9a84-c6dca6f8eb5f tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:43:44.499950 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-2d3471be-b924-48d5-9a84-c6dca6f8eb5f tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] 10.222.0.45 "POST /compute/v2.1/servers/daedf7bb-47ff-460d-bfb4-ac6166801f10/action" status: 200 len: 14 microversion: 2.1 time: 0.091980 Jan 21 09:43:44.506194 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 553/1102] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Jan 21 09:43:44 2022] POST /compute/v2.1/servers/daedf7bb-47ff-460d-bfb4-ac6166801f10/action => generated 14 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 21 09:43:45.515725 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-76978885-8e41-4066-b04a-b016aadbf391 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:43:45.516865 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-76978885-8e41-4066-b04a-b016aadbf391 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] [instance: daedf7bb-47ff-460d-bfb4-ac6166801f10] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:43:45.525171 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-76978885-8e41-4066-b04a-b016aadbf391 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:43:45.525756 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-76978885-8e41-4066-b04a-b016aadbf391 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:43:45.526572 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-76978885-8e41-4066-b04a-b016aadbf391 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:43:45.527003 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-76978885-8e41-4066-b04a-b016aadbf391 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:43:45.595642 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-76978885-8e41-4066-b04a-b016aadbf391 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] 10.222.0.45 "POST /compute/v2.1/servers/daedf7bb-47ff-460d-bfb4-ac6166801f10/action" status: 200 len: 14 microversion: 2.1 time: 0.084228 Jan 21 09:43:45.598968 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 550/1103] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Jan 21 09:43:45 2022] POST /compute/v2.1/servers/daedf7bb-47ff-460d-bfb4-ac6166801f10/action => generated 14 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 21 09:43:46.607637 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-4670e78d-afe0-4094-bba6-be776add53f3 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:43:46.609853 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-4670e78d-afe0-4094-bba6-be776add53f3 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] [instance: daedf7bb-47ff-460d-bfb4-ac6166801f10] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:43:46.617432 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-4670e78d-afe0-4094-bba6-be776add53f3 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:43:46.617921 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-4670e78d-afe0-4094-bba6-be776add53f3 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:43:46.618730 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-4670e78d-afe0-4094-bba6-be776add53f3 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:43:46.619167 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-4670e78d-afe0-4094-bba6-be776add53f3 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:43:46.683538 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-4670e78d-afe0-4094-bba6-be776add53f3 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] 10.222.0.45 "POST /compute/v2.1/servers/daedf7bb-47ff-460d-bfb4-ac6166801f10/action" status: 200 len: 14 microversion: 2.1 time: 0.079508 Jan 21 09:43:46.684727 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 554/1104] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Jan 21 09:43:46 2022] POST /compute/v2.1/servers/daedf7bb-47ff-460d-bfb4-ac6166801f10/action => generated 14 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jan 21 09:43:47.695951 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-b64fbad0-7e2c-42ea-b456-d99897275f80 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:43:47.696996 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-b64fbad0-7e2c-42ea-b456-d99897275f80 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] [instance: daedf7bb-47ff-460d-bfb4-ac6166801f10] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:43:47.705611 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-b64fbad0-7e2c-42ea-b456-d99897275f80 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:43:47.706074 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-b64fbad0-7e2c-42ea-b456-d99897275f80 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:43:47.706906 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-b64fbad0-7e2c-42ea-b456-d99897275f80 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:43:47.707355 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-b64fbad0-7e2c-42ea-b456-d99897275f80 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:43:47.780061 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-b64fbad0-7e2c-42ea-b456-d99897275f80 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] 10.222.0.45 "POST /compute/v2.1/servers/daedf7bb-47ff-460d-bfb4-ac6166801f10/action" status: 200 len: 14 microversion: 2.1 time: 0.087608 Jan 21 09:43:47.781168 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 551/1105] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Jan 21 09:43:47 2022] POST /compute/v2.1/servers/daedf7bb-47ff-460d-bfb4-ac6166801f10/action => generated 14 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 21 09:43:48.794604 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-6eb4ba5e-6b1d-4d74-94b6-29f531d91799 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:43:48.795638 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-6eb4ba5e-6b1d-4d74-94b6-29f531d91799 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] [instance: daedf7bb-47ff-460d-bfb4-ac6166801f10] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:43:48.803151 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-6eb4ba5e-6b1d-4d74-94b6-29f531d91799 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:43:48.803606 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-6eb4ba5e-6b1d-4d74-94b6-29f531d91799 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:43:48.804515 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-6eb4ba5e-6b1d-4d74-94b6-29f531d91799 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:43:48.804960 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-6eb4ba5e-6b1d-4d74-94b6-29f531d91799 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:43:48.865859 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-6eb4ba5e-6b1d-4d74-94b6-29f531d91799 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] 10.222.0.45 "POST /compute/v2.1/servers/daedf7bb-47ff-460d-bfb4-ac6166801f10/action" status: 200 len: 14 microversion: 2.1 time: 0.076321 Jan 21 09:43:48.869097 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 555/1106] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Jan 21 09:43:48 2022] POST /compute/v2.1/servers/daedf7bb-47ff-460d-bfb4-ac6166801f10/action => generated 14 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 21 09:43:49.878140 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-8ccd5255-9ca8-452c-abc3-a17d16092b97 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:43:49.879148 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-8ccd5255-9ca8-452c-abc3-a17d16092b97 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] [instance: daedf7bb-47ff-460d-bfb4-ac6166801f10] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:43:49.886403 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-8ccd5255-9ca8-452c-abc3-a17d16092b97 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:43:49.886849 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-8ccd5255-9ca8-452c-abc3-a17d16092b97 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:43:49.887649 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-8ccd5255-9ca8-452c-abc3-a17d16092b97 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:43:49.888082 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-8ccd5255-9ca8-452c-abc3-a17d16092b97 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:43:49.957292 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-8ccd5255-9ca8-452c-abc3-a17d16092b97 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] 10.222.0.45 "POST /compute/v2.1/servers/daedf7bb-47ff-460d-bfb4-ac6166801f10/action" status: 200 len: 14 microversion: 2.1 time: 0.083853 Jan 21 09:43:49.957920 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 552/1107] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Jan 21 09:43:49 2022] POST /compute/v2.1/servers/daedf7bb-47ff-460d-bfb4-ac6166801f10/action => generated 14 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 21 09:43:50.968511 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-73c47b62-e74d-4ba0-ad8e-75702e62e160 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:43:50.970358 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-73c47b62-e74d-4ba0-ad8e-75702e62e160 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] [instance: daedf7bb-47ff-460d-bfb4-ac6166801f10] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:43:50.977117 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-73c47b62-e74d-4ba0-ad8e-75702e62e160 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:43:50.977905 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-73c47b62-e74d-4ba0-ad8e-75702e62e160 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:43:50.978706 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-73c47b62-e74d-4ba0-ad8e-75702e62e160 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:43:50.979222 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-73c47b62-e74d-4ba0-ad8e-75702e62e160 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:43:51.048175 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-73c47b62-e74d-4ba0-ad8e-75702e62e160 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] 10.222.0.45 "POST /compute/v2.1/servers/daedf7bb-47ff-460d-bfb4-ac6166801f10/action" status: 200 len: 14 microversion: 2.1 time: 0.082973 Jan 21 09:43:51.055040 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 556/1108] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Jan 21 09:43:50 2022] POST /compute/v2.1/servers/daedf7bb-47ff-460d-bfb4-ac6166801f10/action => generated 14 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jan 21 09:43:52.064178 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-d0e4b840-7761-4280-a76a-8a5e5a58283e tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:43:52.065105 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-d0e4b840-7761-4280-a76a-8a5e5a58283e tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] [instance: daedf7bb-47ff-460d-bfb4-ac6166801f10] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:43:52.072434 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-d0e4b840-7761-4280-a76a-8a5e5a58283e tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:43:52.072893 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-d0e4b840-7761-4280-a76a-8a5e5a58283e tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:43:52.073811 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-d0e4b840-7761-4280-a76a-8a5e5a58283e tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:43:52.074268 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-d0e4b840-7761-4280-a76a-8a5e5a58283e tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:43:52.147080 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-d0e4b840-7761-4280-a76a-8a5e5a58283e tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] 10.222.0.45 "POST /compute/v2.1/servers/daedf7bb-47ff-460d-bfb4-ac6166801f10/action" status: 200 len: 6835 microversion: 2.1 time: 0.087709 Jan 21 09:43:52.147715 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 553/1109] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Jan 21 09:43:52 2022] POST /compute/v2.1/servers/daedf7bb-47ff-460d-bfb4-ac6166801f10/action => generated 6835 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:43:53.159725 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-2602f684-f84b-41b0-be27-ccf3d1de7423 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:43:53.160752 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-2602f684-f84b-41b0-be27-ccf3d1de7423 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] [instance: daedf7bb-47ff-460d-bfb4-ac6166801f10] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:43:53.168163 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-2602f684-f84b-41b0-be27-ccf3d1de7423 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:43:53.168593 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-2602f684-f84b-41b0-be27-ccf3d1de7423 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:43:53.169430 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-2602f684-f84b-41b0-be27-ccf3d1de7423 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:43:53.169993 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-2602f684-f84b-41b0-be27-ccf3d1de7423 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:43:53.255165 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-2602f684-f84b-41b0-be27-ccf3d1de7423 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] 10.222.0.45 "POST /compute/v2.1/servers/daedf7bb-47ff-460d-bfb4-ac6166801f10/action" status: 200 len: 15025 microversion: 2.1 time: 0.099966 Jan 21 09:43:53.255837 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 557/1110] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Jan 21 09:43:53 2022] POST /compute/v2.1/servers/daedf7bb-47ff-460d-bfb4-ac6166801f10/action => generated 15025 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 21 09:43:54.269021 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-7d43136a-cba8-4579-ba74-4c274613a226 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:43:54.269600 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-7d43136a-cba8-4579-ba74-4c274613a226 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] [instance: daedf7bb-47ff-460d-bfb4-ac6166801f10] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:43:54.279347 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-7d43136a-cba8-4579-ba74-4c274613a226 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:43:54.280110 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-7d43136a-cba8-4579-ba74-4c274613a226 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:43:54.282019 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-7d43136a-cba8-4579-ba74-4c274613a226 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:43:54.282752 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-7d43136a-cba8-4579-ba74-4c274613a226 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:43:54.364514 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-7d43136a-cba8-4579-ba74-4c274613a226 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] 10.222.0.45 "POST /compute/v2.1/servers/daedf7bb-47ff-460d-bfb4-ac6166801f10/action" status: 200 len: 18155 microversion: 2.1 time: 0.100948 Jan 21 09:43:54.365234 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 554/1111] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Jan 21 09:43:54 2022] POST /compute/v2.1/servers/daedf7bb-47ff-460d-bfb4-ac6166801f10/action => generated 18155 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 21 09:43:55.376855 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-113133c1-fc6f-4734-9546-5c4c79edaeb6 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:43:55.377902 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-113133c1-fc6f-4734-9546-5c4c79edaeb6 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] [instance: daedf7bb-47ff-460d-bfb4-ac6166801f10] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:43:55.385420 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-113133c1-fc6f-4734-9546-5c4c79edaeb6 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:43:55.385874 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-113133c1-fc6f-4734-9546-5c4c79edaeb6 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:43:55.386684 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-113133c1-fc6f-4734-9546-5c4c79edaeb6 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:43:55.387121 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-113133c1-fc6f-4734-9546-5c4c79edaeb6 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:43:55.465179 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-113133c1-fc6f-4734-9546-5c4c79edaeb6 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] 10.222.0.45 "POST /compute/v2.1/servers/daedf7bb-47ff-460d-bfb4-ac6166801f10/action" status: 200 len: 19343 microversion: 2.1 time: 0.092388 Jan 21 09:43:55.465863 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 558/1112] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Jan 21 09:43:55 2022] POST /compute/v2.1/servers/daedf7bb-47ff-460d-bfb4-ac6166801f10/action => generated 19343 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 21 09:43:56.478274 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-225e172a-b55b-4ae0-b7e6-738354ef3c73 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:43:56.479278 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-225e172a-b55b-4ae0-b7e6-738354ef3c73 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] [instance: daedf7bb-47ff-460d-bfb4-ac6166801f10] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:43:56.487097 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-225e172a-b55b-4ae0-b7e6-738354ef3c73 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:43:56.487561 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-225e172a-b55b-4ae0-b7e6-738354ef3c73 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:43:56.493514 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-225e172a-b55b-4ae0-b7e6-738354ef3c73 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:43:56.493514 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-225e172a-b55b-4ae0-b7e6-738354ef3c73 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:43:59.058796 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-225e172a-b55b-4ae0-b7e6-738354ef3c73 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] 10.222.0.45 "POST /compute/v2.1/servers/daedf7bb-47ff-460d-bfb4-ac6166801f10/action" status: 200 len: 24846 microversion: 2.1 time: 2.584330 Jan 21 09:43:59.060688 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 555/1113] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Jan 21 09:43:56 2022] POST /compute/v2.1/servers/daedf7bb-47ff-460d-bfb4-ac6166801f10/action => generated 24846 bytes in 2587 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 21 09:44:00.074411 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-0bce58fd-7784-464f-a83c-5b04ca167213 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:44:00.075323 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-0bce58fd-7784-464f-a83c-5b04ca167213 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] [instance: daedf7bb-47ff-460d-bfb4-ac6166801f10] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:44:00.083636 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-0bce58fd-7784-464f-a83c-5b04ca167213 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:44:00.084087 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-0bce58fd-7784-464f-a83c-5b04ca167213 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:44:00.084914 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-0bce58fd-7784-464f-a83c-5b04ca167213 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:44:00.085604 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-0bce58fd-7784-464f-a83c-5b04ca167213 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:44:00.161749 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-0bce58fd-7784-464f-a83c-5b04ca167213 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] 10.222.0.45 "POST /compute/v2.1/servers/daedf7bb-47ff-460d-bfb4-ac6166801f10/action" status: 200 len: 26221 microversion: 2.1 time: 0.092420 Jan 21 09:44:00.162553 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 559/1114] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Jan 21 09:44:00 2022] POST /compute/v2.1/servers/daedf7bb-47ff-460d-bfb4-ac6166801f10/action => generated 26221 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 21 09:44:01.173949 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-cb139c33-4b45-4c7d-b642-b203275019db tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:44:01.174855 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-cb139c33-4b45-4c7d-b642-b203275019db tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] [instance: daedf7bb-47ff-460d-bfb4-ac6166801f10] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:44:01.183142 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-cb139c33-4b45-4c7d-b642-b203275019db tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:44:01.183587 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-cb139c33-4b45-4c7d-b642-b203275019db tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:44:01.184392 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-cb139c33-4b45-4c7d-b642-b203275019db tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:44:01.184824 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-cb139c33-4b45-4c7d-b642-b203275019db tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:44:01.278242 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-cb139c33-4b45-4c7d-b642-b203275019db tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] 10.222.0.45 "POST /compute/v2.1/servers/daedf7bb-47ff-460d-bfb4-ac6166801f10/action" status: 200 len: 27424 microversion: 2.1 time: 0.107832 Jan 21 09:44:01.279467 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 556/1115] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Jan 21 09:44:01 2022] POST /compute/v2.1/servers/daedf7bb-47ff-460d-bfb4-ac6166801f10/action => generated 27424 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 21 09:44:02.293180 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-ab30fecc-3876-4f24-9fcb-d8815dd9b4e9 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:44:02.294266 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-ab30fecc-3876-4f24-9fcb-d8815dd9b4e9 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] [instance: daedf7bb-47ff-460d-bfb4-ac6166801f10] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:44:02.302475 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-ab30fecc-3876-4f24-9fcb-d8815dd9b4e9 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:44:02.302943 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-ab30fecc-3876-4f24-9fcb-d8815dd9b4e9 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:44:02.303756 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-ab30fecc-3876-4f24-9fcb-d8815dd9b4e9 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:44:02.304200 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-ab30fecc-3876-4f24-9fcb-d8815dd9b4e9 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:44:02.394906 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-ab30fecc-3876-4f24-9fcb-d8815dd9b4e9 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] 10.222.0.45 "POST /compute/v2.1/servers/daedf7bb-47ff-460d-bfb4-ac6166801f10/action" status: 200 len: 27914 microversion: 2.1 time: 0.106003 Jan 21 09:44:02.395625 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 560/1116] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Jan 21 09:44:02 2022] POST /compute/v2.1/servers/daedf7bb-47ff-460d-bfb4-ac6166801f10/action => generated 27914 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 21 09:44:03.409549 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-2ed10172-6609-495c-b02c-0868be87e7b9 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:44:03.410588 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-2ed10172-6609-495c-b02c-0868be87e7b9 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] [instance: daedf7bb-47ff-460d-bfb4-ac6166801f10] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:44:03.418457 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-2ed10172-6609-495c-b02c-0868be87e7b9 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:44:03.418911 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-2ed10172-6609-495c-b02c-0868be87e7b9 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:44:03.419773 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-2ed10172-6609-495c-b02c-0868be87e7b9 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:44:03.420186 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-2ed10172-6609-495c-b02c-0868be87e7b9 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:44:03.509378 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-2ed10172-6609-495c-b02c-0868be87e7b9 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] 10.222.0.45 "POST /compute/v2.1/servers/daedf7bb-47ff-460d-bfb4-ac6166801f10/action" status: 200 len: 28207 microversion: 2.1 time: 0.104915 Jan 21 09:44:03.510525 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 557/1117] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Jan 21 09:44:03 2022] POST /compute/v2.1/servers/daedf7bb-47ff-460d-bfb4-ac6166801f10/action => generated 28207 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 21 09:44:04.523869 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-39fa19a2-a99d-46e9-bbf4-9942aeab4c6e tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:44:04.524808 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-39fa19a2-a99d-46e9-bbf4-9942aeab4c6e tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] [instance: daedf7bb-47ff-460d-bfb4-ac6166801f10] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:44:04.532999 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-39fa19a2-a99d-46e9-bbf4-9942aeab4c6e tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:44:04.544271 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-39fa19a2-a99d-46e9-bbf4-9942aeab4c6e tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:44:04.544271 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-39fa19a2-a99d-46e9-bbf4-9942aeab4c6e tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:44:04.544271 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-39fa19a2-a99d-46e9-bbf4-9942aeab4c6e tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:44:04.604463 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-39fa19a2-a99d-46e9-bbf4-9942aeab4c6e tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] 10.222.0.45 "POST /compute/v2.1/servers/daedf7bb-47ff-460d-bfb4-ac6166801f10/action" status: 200 len: 28207 microversion: 2.1 time: 0.084891 Jan 21 09:44:04.605130 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 561/1118] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Jan 21 09:44:04 2022] POST /compute/v2.1/servers/daedf7bb-47ff-460d-bfb4-ac6166801f10/action => generated 28207 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 21 09:44:05.620138 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-9091972d-ab5d-4042-b8ab-30176d409120 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:44:05.621716 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-9091972d-ab5d-4042-b8ab-30176d409120 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] [instance: daedf7bb-47ff-460d-bfb4-ac6166801f10] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:44:05.630386 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-9091972d-ab5d-4042-b8ab-30176d409120 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:44:05.630861 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-9091972d-ab5d-4042-b8ab-30176d409120 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:44:05.631685 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-9091972d-ab5d-4042-b8ab-30176d409120 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:44:05.632187 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-9091972d-ab5d-4042-b8ab-30176d409120 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:44:05.720334 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-9091972d-ab5d-4042-b8ab-30176d409120 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] 10.222.0.45 "POST /compute/v2.1/servers/daedf7bb-47ff-460d-bfb4-ac6166801f10/action" status: 200 len: 28498 microversion: 2.1 time: 0.104312 Jan 21 09:44:05.721024 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 558/1119] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Jan 21 09:44:05 2022] POST /compute/v2.1/servers/daedf7bb-47ff-460d-bfb4-ac6166801f10/action => generated 28498 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 21 09:44:06.733945 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-b50b1f90-f385-40a4-a696-8cf745ef5d57 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:44:06.735649 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-b50b1f90-f385-40a4-a696-8cf745ef5d57 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] [instance: daedf7bb-47ff-460d-bfb4-ac6166801f10] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:44:06.743766 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-b50b1f90-f385-40a4-a696-8cf745ef5d57 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:44:06.744284 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-b50b1f90-f385-40a4-a696-8cf745ef5d57 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:44:06.745114 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-b50b1f90-f385-40a4-a696-8cf745ef5d57 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:44:06.745629 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-b50b1f90-f385-40a4-a696-8cf745ef5d57 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:44:06.823491 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-b50b1f90-f385-40a4-a696-8cf745ef5d57 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] 10.222.0.45 "POST /compute/v2.1/servers/daedf7bb-47ff-460d-bfb4-ac6166801f10/action" status: 200 len: 28666 microversion: 2.1 time: 0.094276 Jan 21 09:44:06.824164 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 562/1120] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Jan 21 09:44:06 2022] POST /compute/v2.1/servers/daedf7bb-47ff-460d-bfb4-ac6166801f10/action => generated 28666 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 21 09:44:07.836903 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-d28e173f-6617-415e-b037-681957c9fcf4 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:44:07.837999 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-d28e173f-6617-415e-b037-681957c9fcf4 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] [instance: daedf7bb-47ff-460d-bfb4-ac6166801f10] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:44:07.846469 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-d28e173f-6617-415e-b037-681957c9fcf4 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:44:07.852406 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-d28e173f-6617-415e-b037-681957c9fcf4 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:44:07.852406 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-d28e173f-6617-415e-b037-681957c9fcf4 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:44:07.852406 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-d28e173f-6617-415e-b037-681957c9fcf4 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:44:07.915820 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-d28e173f-6617-415e-b037-681957c9fcf4 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] 10.222.0.45 "POST /compute/v2.1/servers/daedf7bb-47ff-460d-bfb4-ac6166801f10/action" status: 200 len: 28666 microversion: 2.1 time: 0.083490 Jan 21 09:44:07.916473 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 559/1121] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Jan 21 09:44:07 2022] POST /compute/v2.1/servers/daedf7bb-47ff-460d-bfb4-ac6166801f10/action => generated 28666 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 21 09:44:08.928943 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-4591b228-311f-4490-a1e6-9402d566ee24 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:44:08.930209 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-4591b228-311f-4490-a1e6-9402d566ee24 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] [instance: daedf7bb-47ff-460d-bfb4-ac6166801f10] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:44:08.937971 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-4591b228-311f-4490-a1e6-9402d566ee24 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:44:08.938531 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-4591b228-311f-4490-a1e6-9402d566ee24 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:44:08.939394 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-4591b228-311f-4490-a1e6-9402d566ee24 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:44:08.939897 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-4591b228-311f-4490-a1e6-9402d566ee24 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:44:09.010361 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-4591b228-311f-4490-a1e6-9402d566ee24 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] 10.222.0.45 "POST /compute/v2.1/servers/daedf7bb-47ff-460d-bfb4-ac6166801f10/action" status: 200 len: 28666 microversion: 2.1 time: 0.085635 Jan 21 09:44:09.011112 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 563/1122] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Jan 21 09:44:08 2022] POST /compute/v2.1/servers/daedf7bb-47ff-460d-bfb4-ac6166801f10/action => generated 28666 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 21 09:44:10.026004 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-576625a8-1a3c-42a5-8dce-120353f8a2cf tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:44:10.027174 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-576625a8-1a3c-42a5-8dce-120353f8a2cf tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] [instance: daedf7bb-47ff-460d-bfb4-ac6166801f10] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:44:10.035097 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-576625a8-1a3c-42a5-8dce-120353f8a2cf tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:44:10.035541 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-576625a8-1a3c-42a5-8dce-120353f8a2cf tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:44:10.036340 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-576625a8-1a3c-42a5-8dce-120353f8a2cf tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:44:10.036782 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-576625a8-1a3c-42a5-8dce-120353f8a2cf tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:44:10.117701 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-576625a8-1a3c-42a5-8dce-120353f8a2cf tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] 10.222.0.45 "POST /compute/v2.1/servers/daedf7bb-47ff-460d-bfb4-ac6166801f10/action" status: 200 len: 29028 microversion: 2.1 time: 0.097172 Jan 21 09:44:10.118376 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 560/1123] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Jan 21 09:44:10 2022] POST /compute/v2.1/servers/daedf7bb-47ff-460d-bfb4-ac6166801f10/action => generated 29028 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 21 09:44:11.131029 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-2a162207-5382-4e3d-9fd1-53c7c4a219d9 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:44:11.132045 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-2a162207-5382-4e3d-9fd1-53c7c4a219d9 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] [instance: daedf7bb-47ff-460d-bfb4-ac6166801f10] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:44:11.139627 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-2a162207-5382-4e3d-9fd1-53c7c4a219d9 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:44:11.140713 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-2a162207-5382-4e3d-9fd1-53c7c4a219d9 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:44:11.141572 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-2a162207-5382-4e3d-9fd1-53c7c4a219d9 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:44:11.142209 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-2a162207-5382-4e3d-9fd1-53c7c4a219d9 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:44:11.222849 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-2a162207-5382-4e3d-9fd1-53c7c4a219d9 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] 10.222.0.45 "POST /compute/v2.1/servers/daedf7bb-47ff-460d-bfb4-ac6166801f10/action" status: 200 len: 31170 microversion: 2.1 time: 0.095594 Jan 21 09:44:11.223858 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 564/1124] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Jan 21 09:44:11 2022] POST /compute/v2.1/servers/daedf7bb-47ff-460d-bfb4-ac6166801f10/action => generated 31170 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 21 09:44:12.236166 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-01e720b6-1de0-476c-aeef-4d4bf54411a9 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:44:12.237976 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-01e720b6-1de0-476c-aeef-4d4bf54411a9 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] [instance: daedf7bb-47ff-460d-bfb4-ac6166801f10] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:44:12.245569 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-01e720b6-1de0-476c-aeef-4d4bf54411a9 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:44:12.246351 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-01e720b6-1de0-476c-aeef-4d4bf54411a9 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:44:12.247329 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-01e720b6-1de0-476c-aeef-4d4bf54411a9 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:44:12.247776 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-01e720b6-1de0-476c-aeef-4d4bf54411a9 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:44:12.332157 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-01e720b6-1de0-476c-aeef-4d4bf54411a9 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] 10.222.0.45 "POST /compute/v2.1/servers/daedf7bb-47ff-460d-bfb4-ac6166801f10/action" status: 200 len: 32657 microversion: 2.1 time: 0.099888 Jan 21 09:44:12.333340 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 561/1125] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Jan 21 09:44:12 2022] POST /compute/v2.1/servers/daedf7bb-47ff-460d-bfb4-ac6166801f10/action => generated 32657 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 21 09:44:13.346445 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-f521d316-eee9-4311-9dea-1f67e32add47 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:44:13.347407 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-f521d316-eee9-4311-9dea-1f67e32add47 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] [instance: daedf7bb-47ff-460d-bfb4-ac6166801f10] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:44:13.354721 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-f521d316-eee9-4311-9dea-1f67e32add47 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:44:13.355178 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-f521d316-eee9-4311-9dea-1f67e32add47 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:44:13.355979 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-f521d316-eee9-4311-9dea-1f67e32add47 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:44:13.356414 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-f521d316-eee9-4311-9dea-1f67e32add47 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:44:13.443698 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-f521d316-eee9-4311-9dea-1f67e32add47 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] 10.222.0.45 "POST /compute/v2.1/servers/daedf7bb-47ff-460d-bfb4-ac6166801f10/action" status: 200 len: 33669 microversion: 2.1 time: 0.102062 Jan 21 09:44:13.444394 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 565/1126] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Jan 21 09:44:13 2022] POST /compute/v2.1/servers/daedf7bb-47ff-460d-bfb4-ac6166801f10/action => generated 33669 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 21 09:44:14.457411 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-90ad0cee-8158-4224-9a1f-8a9f050f380c tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:44:14.458417 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-90ad0cee-8158-4224-9a1f-8a9f050f380c tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] [instance: daedf7bb-47ff-460d-bfb4-ac6166801f10] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:44:14.465596 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-90ad0cee-8158-4224-9a1f-8a9f050f380c tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:44:14.466046 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-90ad0cee-8158-4224-9a1f-8a9f050f380c tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:44:14.466846 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-90ad0cee-8158-4224-9a1f-8a9f050f380c tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:44:14.467287 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-90ad0cee-8158-4224-9a1f-8a9f050f380c tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:44:16.075920 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-90ad0cee-8158-4224-9a1f-8a9f050f380c tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] 10.222.0.45 "POST /compute/v2.1/servers/daedf7bb-47ff-460d-bfb4-ac6166801f10/action" status: 200 len: 37037 microversion: 2.1 time: 1.622887 Jan 21 09:44:16.076582 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 562/1127] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Jan 21 09:44:14 2022] POST /compute/v2.1/servers/daedf7bb-47ff-460d-bfb4-ac6166801f10/action => generated 37037 bytes in 1625 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 21 09:44:17.090107 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-0d71024b-2723-41a1-a593-3b18fdf647af tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:44:17.091044 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-0d71024b-2723-41a1-a593-3b18fdf647af tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] [instance: daedf7bb-47ff-460d-bfb4-ac6166801f10] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:44:17.099329 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-0d71024b-2723-41a1-a593-3b18fdf647af tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:44:17.103923 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-0d71024b-2723-41a1-a593-3b18fdf647af tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:44:17.103923 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-0d71024b-2723-41a1-a593-3b18fdf647af tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:44:17.103923 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-0d71024b-2723-41a1-a593-3b18fdf647af tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:44:17.174382 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-0d71024b-2723-41a1-a593-3b18fdf647af tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] 10.222.0.45 "POST /compute/v2.1/servers/daedf7bb-47ff-460d-bfb4-ac6166801f10/action" status: 200 len: 38193 microversion: 2.1 time: 0.088394 Jan 21 09:44:17.175312 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 566/1128] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Jan 21 09:44:17 2022] POST /compute/v2.1/servers/daedf7bb-47ff-460d-bfb4-ac6166801f10/action => generated 38193 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 21 09:44:18.187545 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-ff743265-b3b9-40c9-a99f-8e9122b07ccc tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:44:18.189347 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-ff743265-b3b9-40c9-a99f-8e9122b07ccc tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] [instance: daedf7bb-47ff-460d-bfb4-ac6166801f10] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:44:18.199094 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-ff743265-b3b9-40c9-a99f-8e9122b07ccc tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:44:18.199597 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-ff743265-b3b9-40c9-a99f-8e9122b07ccc tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:44:18.200762 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-ff743265-b3b9-40c9-a99f-8e9122b07ccc tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:44:18.201285 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-ff743265-b3b9-40c9-a99f-8e9122b07ccc tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:44:18.284401 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-ff743265-b3b9-40c9-a99f-8e9122b07ccc tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] 10.222.0.45 "POST /compute/v2.1/servers/daedf7bb-47ff-460d-bfb4-ac6166801f10/action" status: 200 len: 38193 microversion: 2.1 time: 0.100964 Jan 21 09:44:18.285098 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 563/1129] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Jan 21 09:44:18 2022] POST /compute/v2.1/servers/daedf7bb-47ff-460d-bfb4-ac6166801f10/action => generated 38193 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 21 09:44:19.302516 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-e145fd45-58c6-43ee-b566-6e3c89b15800 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:44:19.303652 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-e145fd45-58c6-43ee-b566-6e3c89b15800 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] [instance: daedf7bb-47ff-460d-bfb4-ac6166801f10] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:44:19.317113 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-e145fd45-58c6-43ee-b566-6e3c89b15800 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:44:19.317681 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-e145fd45-58c6-43ee-b566-6e3c89b15800 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:44:19.318545 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-e145fd45-58c6-43ee-b566-6e3c89b15800 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:44:19.318998 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-e145fd45-58c6-43ee-b566-6e3c89b15800 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:44:19.394569 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-e145fd45-58c6-43ee-b566-6e3c89b15800 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] 10.222.0.45 "POST /compute/v2.1/servers/daedf7bb-47ff-460d-bfb4-ac6166801f10/action" status: 200 len: 38193 microversion: 2.1 time: 0.095999 Jan 21 09:44:19.395247 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 567/1130] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Jan 21 09:44:19 2022] POST /compute/v2.1/servers/daedf7bb-47ff-460d-bfb4-ac6166801f10/action => generated 38193 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jan 21 09:44:20.409793 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-9a188441-7c48-4a40-80f9-a9484f822f39 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:44:20.411606 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-9a188441-7c48-4a40-80f9-a9484f822f39 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] [instance: daedf7bb-47ff-460d-bfb4-ac6166801f10] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:44:20.420199 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-9a188441-7c48-4a40-80f9-a9484f822f39 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:44:20.420692 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-9a188441-7c48-4a40-80f9-a9484f822f39 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:44:20.421631 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-9a188441-7c48-4a40-80f9-a9484f822f39 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:44:20.422144 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-9a188441-7c48-4a40-80f9-a9484f822f39 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:44:23.647096 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-9a188441-7c48-4a40-80f9-a9484f822f39 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] 10.222.0.45 "POST /compute/v2.1/servers/daedf7bb-47ff-460d-bfb4-ac6166801f10/action" status: 200 len: 38320 microversion: 2.1 time: 3.243818 Jan 21 09:44:23.647850 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 564/1131] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Jan 21 09:44:20 2022] POST /compute/v2.1/servers/daedf7bb-47ff-460d-bfb4-ac6166801f10/action => generated 38320 bytes in 3246 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jan 21 09:44:23.659330 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-50428e9c-88b6-42f7-b103-e30d60c27bcd tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:44:23.660411 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-50428e9c-88b6-42f7-b103-e30d60c27bcd tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] [instance: daedf7bb-47ff-460d-bfb4-ac6166801f10] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:44:23.670683 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-50428e9c-88b6-42f7-b103-e30d60c27bcd tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:44:23.673299 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-50428e9c-88b6-42f7-b103-e30d60c27bcd tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:44:23.673299 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-50428e9c-88b6-42f7-b103-e30d60c27bcd tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:44:23.673299 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-50428e9c-88b6-42f7-b103-e30d60c27bcd tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:44:23.698475 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-50428e9c-88b6-42f7-b103-e30d60c27bcd tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] 10.222.0.45 "GET /compute/v2.1/servers/daedf7bb-47ff-460d-bfb4-ac6166801f10/ips" status: 200 len: 146 microversion: 2.1 time: 0.043958 Jan 21 09:44:23.701977 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 568/1132] 10.222.0.45 () {58 vars in 1247 bytes} [Fri Jan 21 09:44:23 2022] GET /compute/v2.1/servers/daedf7bb-47ff-460d-bfb4-ac6166801f10/ips => generated 146 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 21 09:44:26.544277 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-27c89b7f-a6c9-46af-97a9-b6938339613b tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-925814373", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-772796190", "security_groups": [{"name": "tempest-secgroup-smoke-159313003"}], "block_device_mapping_v2": [{"uuid": "a00a40f9-cc14-4713-bf22-a4f2c1c7dd6c", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "858c4f17-92ac-4cda-9750-b98e2d3705f8"}]}} {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:44:26.684065 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.network.neutron [None req-27c89b7f-a6c9-46af-97a9-b6938339613b tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] validate_networks() for [('858c4f17-92ac-4cda-9750-b98e2d3705f8', None, None, None, None, None)] {{(pid=123386) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 21 09:44:27.104466 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.virt.hardware [None req-27c89b7f-a6c9-46af-97a9-b6938339613b tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Flavor limits 0:0:0 {{(pid=123386) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 21 09:44:27.104466 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.virt.hardware [None req-27c89b7f-a6c9-46af-97a9-b6938339613b tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Image limits 0:0:0 {{(pid=123386) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 21 09:44:27.104466 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.virt.hardware [None req-27c89b7f-a6c9-46af-97a9-b6938339613b tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Flavor pref 0:0:0 {{(pid=123386) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 21 09:44:27.104904 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.virt.hardware [None req-27c89b7f-a6c9-46af-97a9-b6938339613b tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Image pref 0:0:0 {{(pid=123386) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 21 09:44:27.105360 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.virt.hardware [None req-27c89b7f-a6c9-46af-97a9-b6938339613b tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123386) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 21 09:44:27.115955 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-27c89b7f-a6c9-46af-97a9-b6938339613b tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:44:27.116401 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-27c89b7f-a6c9-46af-97a9-b6938339613b tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:44:27.117252 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-27c89b7f-a6c9-46af-97a9-b6938339613b tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:44:27.117695 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-27c89b7f-a6c9-46af-97a9-b6938339613b tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:44:27.134532 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.quota [None req-27c89b7f-a6c9-46af-97a9-b6938339613b tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Getting quotas for project 515ded26ca114fbf9c6e920362aec64c. Resources: {'cores', 'instances', 'ram'} {{(pid=123386) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 21 09:44:27.139031 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.quota [None req-27c89b7f-a6c9-46af-97a9-b6938339613b tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Getting quotas for user 3d53a7fa2cb5498aa916817b82dba77e and project 515ded26ca114fbf9c6e920362aec64c. Resources: {'cores', 'instances', 'ram'} {{(pid=123386) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 21 09:44:27.199854 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-27c89b7f-a6c9-46af-97a9-b6938339613b tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Going to run 1 instances... {{(pid=123386) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 21 09:44:27.202208 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-27c89b7f-a6c9-46af-97a9-b6938339613b tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] [instance: 325f56a1-8c36-43e5-9896-52f6713a7ba0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='a00a40f9-cc14-4713-bf22-a4f2c1c7dd6c',volume_size=None,volume_type=None)] {{(pid=123386) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 21 09:44:27.675445 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-6aa706ca-8030-4f4c-bea4-d6aed2716911 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b296c912-ef9d-40cb-a475-035245bb279f"}} {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:44:27.677477 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-6aa706ca-8030-4f4c-bea4-d6aed2716911 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] [instance: daedf7bb-47ff-460d-bfb4-ac6166801f10] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:44:27.686423 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-6aa706ca-8030-4f4c-bea4-d6aed2716911 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:44:27.686886 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-6aa706ca-8030-4f4c-bea4-d6aed2716911 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:44:27.687688 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-6aa706ca-8030-4f4c-bea4-d6aed2716911 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:44:27.688136 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-6aa706ca-8030-4f4c-bea4-d6aed2716911 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:44:27.779096 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-27c89b7f-a6c9-46af-97a9-b6938339613b tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.238823 Jan 21 09:44:27.779912 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 565/1133] 10.222.0.45 () {60 vars in 1146 bytes} [Fri Jan 21 09:44:26 2022] POST /compute/v2.1/servers => generated 405 bytes in 1241 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 21 09:44:27.790844 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-e66016c8-0b46-4b40-aeba-82400a6c8c87 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:44:27.791586 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-e66016c8-0b46-4b40-aeba-82400a6c8c87 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] [instance: 325f56a1-8c36-43e5-9896-52f6713a7ba0] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:44:27.858190 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-e66016c8-0b46-4b40-aeba-82400a6c8c87 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d53a7fa2cb5498aa916817b82dba77e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515ded26ca114fbf9c6e920362aec64c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:44:27.865738 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-e66016c8-0b46-4b40-aeba-82400a6c8c87 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] 10.222.0.45 "GET /compute/v2.1/servers/325f56a1-8c36-43e5-9896-52f6713a7ba0" status: 200 len: 1093 microversion: 2.1 time: 0.078882 Jan 21 09:44:27.866323 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 566/1134] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:44:27 2022] GET /compute/v2.1/servers/325f56a1-8c36-43e5-9896-52f6713a7ba0 => generated 1093 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 09:44:28.584641 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-6aa706ca-8030-4f4c-bea4-d6aed2716911 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] 10.222.0.45 "POST /compute/v2.1/servers/daedf7bb-47ff-460d-bfb4-ac6166801f10/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.912777 Jan 21 09:44:28.586572 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 569/1135] 10.222.0.45 () {60 vars in 1322 bytes} [Fri Jan 21 09:44:27 2022] POST /compute/v2.1/servers/daedf7bb-47ff-460d-bfb4-ac6166801f10/os-volume_attachments => generated 194 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 21 09:44:28.887751 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-fb792552-269c-4e8b-b4b1-a3a8d98c2628 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:44:28.888915 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-fb792552-269c-4e8b-b4b1-a3a8d98c2628 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] [instance: 325f56a1-8c36-43e5-9896-52f6713a7ba0] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:44:28.897657 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-fb792552-269c-4e8b-b4b1-a3a8d98c2628 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:44:28.898156 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-fb792552-269c-4e8b-b4b1-a3a8d98c2628 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:44:28.898974 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-fb792552-269c-4e8b-b4b1-a3a8d98c2628 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:44:28.899438 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-fb792552-269c-4e8b-b4b1-a3a8d98c2628 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:44:28.971116 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-fb792552-269c-4e8b-b4b1-a3a8d98c2628 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d53a7fa2cb5498aa916817b82dba77e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515ded26ca114fbf9c6e920362aec64c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:44:28.980877 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-fb792552-269c-4e8b-b4b1-a3a8d98c2628 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] 10.222.0.45 "GET /compute/v2.1/servers/325f56a1-8c36-43e5-9896-52f6713a7ba0" status: 200 len: 1143 microversion: 2.1 time: 0.099537 Jan 21 09:44:28.980877 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 567/1136] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:44:28 2022] GET /compute/v2.1/servers/325f56a1-8c36-43e5-9896-52f6713a7ba0 => generated 1143 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:44:30.000833 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-09b70a37-32f8-44b6-8c49-84b97af00eba tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:44:30.001467 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-09b70a37-32f8-44b6-8c49-84b97af00eba tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] [instance: 325f56a1-8c36-43e5-9896-52f6713a7ba0] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:44:30.008662 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-09b70a37-32f8-44b6-8c49-84b97af00eba tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:44:30.009207 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-09b70a37-32f8-44b6-8c49-84b97af00eba tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:44:30.010000 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-09b70a37-32f8-44b6-8c49-84b97af00eba tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:44:30.010434 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-09b70a37-32f8-44b6-8c49-84b97af00eba tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:44:30.090868 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-09b70a37-32f8-44b6-8c49-84b97af00eba tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d53a7fa2cb5498aa916817b82dba77e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515ded26ca114fbf9c6e920362aec64c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:44:30.099968 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-09b70a37-32f8-44b6-8c49-84b97af00eba tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] 10.222.0.45 "GET /compute/v2.1/servers/325f56a1-8c36-43e5-9896-52f6713a7ba0" status: 200 len: 1199 microversion: 2.1 time: 0.103873 Jan 21 09:44:30.100563 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 570/1137] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:44:29 2022] GET /compute/v2.1/servers/325f56a1-8c36-43e5-9896-52f6713a7ba0 => generated 1199 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:44:31.123756 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-e140bf41-2596-4fa3-960f-8013313683ca tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:44:31.127983 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-e140bf41-2596-4fa3-960f-8013313683ca tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] [instance: 325f56a1-8c36-43e5-9896-52f6713a7ba0] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:44:31.142330 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-e140bf41-2596-4fa3-960f-8013313683ca tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:44:31.142771 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-e140bf41-2596-4fa3-960f-8013313683ca tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:44:31.143768 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-e140bf41-2596-4fa3-960f-8013313683ca tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:44:31.144383 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-e140bf41-2596-4fa3-960f-8013313683ca tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:44:31.500452 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-e140bf41-2596-4fa3-960f-8013313683ca tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d53a7fa2cb5498aa916817b82dba77e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515ded26ca114fbf9c6e920362aec64c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:44:31.509442 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-e140bf41-2596-4fa3-960f-8013313683ca tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] 10.222.0.45 "GET /compute/v2.1/servers/325f56a1-8c36-43e5-9896-52f6713a7ba0" status: 200 len: 1276 microversion: 2.1 time: 0.389142 Jan 21 09:44:31.510037 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 568/1138] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:44:31 2022] GET /compute/v2.1/servers/325f56a1-8c36-43e5-9896-52f6713a7ba0 => generated 1276 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:44:32.072975 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [req-649a8bb1-0fd8-4c09-914f-95420ae32dae req-0c59c29e-8e59-470a-8988-a457dd3f7f46 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "325f56a1-8c36-43e5-9896-52f6713a7ba0", "tag": "8a2eff4f-a260-4ac8-8540-0f38c10b4796"}]} {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:44:32.074805 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 21 09:44:32.074805 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: warnings.warn(msg) Jan 21 09:44:32.084218 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [req-649a8bb1-0fd8-4c09-914f-95420ae32dae req-0c59c29e-8e59-470a-8988-a457dd3f7f46 service nova] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:44:32.084768 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [req-649a8bb1-0fd8-4c09-914f-95420ae32dae req-0c59c29e-8e59-470a-8988-a457dd3f7f46 service nova] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:44:32.101576 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.compute.server_external_events [req-649a8bb1-0fd8-4c09-914f-95420ae32dae req-0c59c29e-8e59-470a-8988-a457dd3f7f46 service nova] Creating event network-changed:8a2eff4f-a260-4ac8-8540-0f38c10b4796 for instance 325f56a1-8c36-43e5-9896-52f6713a7ba0 on hv-cinder-80403 Jan 21 09:44:32.107647 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [req-649a8bb1-0fd8-4c09-914f-95420ae32dae req-0c59c29e-8e59-470a-8988-a457dd3f7f46 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045291 Jan 21 09:44:32.108897 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 571/1139] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Jan 21 09:44:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 09:44:32.526668 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-a0355452-a244-4bb4-8b24-4af9bdfc941e tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:44:32.527276 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-a0355452-a244-4bb4-8b24-4af9bdfc941e tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] [instance: 325f56a1-8c36-43e5-9896-52f6713a7ba0] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:44:32.534068 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-a0355452-a244-4bb4-8b24-4af9bdfc941e tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:44:32.534616 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-a0355452-a244-4bb4-8b24-4af9bdfc941e tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:44:32.536163 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-a0355452-a244-4bb4-8b24-4af9bdfc941e tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:44:32.536679 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-a0355452-a244-4bb4-8b24-4af9bdfc941e tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:44:32.792630 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-a0355452-a244-4bb4-8b24-4af9bdfc941e tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d53a7fa2cb5498aa916817b82dba77e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515ded26ca114fbf9c6e920362aec64c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:44:32.802679 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-a0355452-a244-4bb4-8b24-4af9bdfc941e tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] 10.222.0.45 "GET /compute/v2.1/servers/325f56a1-8c36-43e5-9896-52f6713a7ba0" status: 200 len: 1276 microversion: 2.1 time: 0.279573 Jan 21 09:44:32.803311 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 569/1140] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:44:32 2022] GET /compute/v2.1/servers/325f56a1-8c36-43e5-9896-52f6713a7ba0 => generated 1276 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:44:33.820711 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-e44c7af7-48bf-45fe-849b-78069a69d3a4 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:44:33.821464 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-e44c7af7-48bf-45fe-849b-78069a69d3a4 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] [instance: 325f56a1-8c36-43e5-9896-52f6713a7ba0] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:44:33.828257 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-e44c7af7-48bf-45fe-849b-78069a69d3a4 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:44:33.828655 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-e44c7af7-48bf-45fe-849b-78069a69d3a4 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:44:33.829478 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-e44c7af7-48bf-45fe-849b-78069a69d3a4 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:44:33.829910 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-e44c7af7-48bf-45fe-849b-78069a69d3a4 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:44:34.000079 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-e44c7af7-48bf-45fe-849b-78069a69d3a4 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d53a7fa2cb5498aa916817b82dba77e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515ded26ca114fbf9c6e920362aec64c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:44:34.008552 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-e44c7af7-48bf-45fe-849b-78069a69d3a4 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] 10.222.0.45 "GET /compute/v2.1/servers/325f56a1-8c36-43e5-9896-52f6713a7ba0" status: 200 len: 1276 microversion: 2.1 time: 0.192562 Jan 21 09:44:34.009168 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 572/1141] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:44:33 2022] GET /compute/v2.1/servers/325f56a1-8c36-43e5-9896-52f6713a7ba0 => generated 1276 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:44:35.026810 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-e62e3d30-2745-4d7d-a562-615e041fab7c tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:44:35.027534 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-e62e3d30-2745-4d7d-a562-615e041fab7c tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] [instance: 325f56a1-8c36-43e5-9896-52f6713a7ba0] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:44:35.034500 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-e62e3d30-2745-4d7d-a562-615e041fab7c tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:44:35.034905 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-e62e3d30-2745-4d7d-a562-615e041fab7c tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:44:35.035691 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-e62e3d30-2745-4d7d-a562-615e041fab7c tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:44:35.036120 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-e62e3d30-2745-4d7d-a562-615e041fab7c tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:44:35.201689 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-e62e3d30-2745-4d7d-a562-615e041fab7c tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d53a7fa2cb5498aa916817b82dba77e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515ded26ca114fbf9c6e920362aec64c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:44:35.215068 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-e62e3d30-2745-4d7d-a562-615e041fab7c tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] 10.222.0.45 "GET /compute/v2.1/servers/325f56a1-8c36-43e5-9896-52f6713a7ba0" status: 200 len: 1276 microversion: 2.1 time: 0.191802 Jan 21 09:44:35.216153 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 570/1142] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:44:35 2022] GET /compute/v2.1/servers/325f56a1-8c36-43e5-9896-52f6713a7ba0 => generated 1276 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:44:36.196631 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-6e86b8b8-4923-46ea-8e51-a2fc9f2dae6d tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:44:36.197642 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-6e86b8b8-4923-46ea-8e51-a2fc9f2dae6d tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] [instance: daedf7bb-47ff-460d-bfb4-ac6166801f10] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:44:36.204447 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-6e86b8b8-4923-46ea-8e51-a2fc9f2dae6d tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:44:36.204844 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-6e86b8b8-4923-46ea-8e51-a2fc9f2dae6d tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:44:36.205770 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-6e86b8b8-4923-46ea-8e51-a2fc9f2dae6d tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:44:36.206142 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-6e86b8b8-4923-46ea-8e51-a2fc9f2dae6d tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:44:36.236912 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-082ee61f-8e0c-4df6-bd53-e15331fc1bc1 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:44:36.238641 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-082ee61f-8e0c-4df6-bd53-e15331fc1bc1 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] [instance: 325f56a1-8c36-43e5-9896-52f6713a7ba0] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:44:36.240996 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-6e86b8b8-4923-46ea-8e51-a2fc9f2dae6d tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] 10.222.0.45 "GET /compute/v2.1/servers/daedf7bb-47ff-460d-bfb4-ac6166801f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048151 Jan 21 09:44:36.242004 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 573/1143] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Jan 21 09:44:36 2022] GET /compute/v2.1/servers/daedf7bb-47ff-460d-bfb4-ac6166801f10/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 09:44:36.245943 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-082ee61f-8e0c-4df6-bd53-e15331fc1bc1 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:44:36.247009 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-082ee61f-8e0c-4df6-bd53-e15331fc1bc1 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:44:36.248729 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-082ee61f-8e0c-4df6-bd53-e15331fc1bc1 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:44:36.249460 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-082ee61f-8e0c-4df6-bd53-e15331fc1bc1 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:44:36.264374 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-4ca711e7-2f07-4fe0-903b-0cc7d3e49412 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:44:36.264882 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-4ca711e7-2f07-4fe0-903b-0cc7d3e49412 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] [instance: daedf7bb-47ff-460d-bfb4-ac6166801f10] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:44:36.284846 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-4ca711e7-2f07-4fe0-903b-0cc7d3e49412 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:44:36.285338 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-4ca711e7-2f07-4fe0-903b-0cc7d3e49412 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:44:36.286426 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-4ca711e7-2f07-4fe0-903b-0cc7d3e49412 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:44:36.286991 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-4ca711e7-2f07-4fe0-903b-0cc7d3e49412 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:44:36.322399 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-4ca711e7-2f07-4fe0-903b-0cc7d3e49412 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] 10.222.0.45 "GET /compute/v2.1/servers/daedf7bb-47ff-460d-bfb4-ac6166801f10/os-volume_attachments/b296c912-ef9d-40cb-a475-035245bb279f" status: 200 len: 194 microversion: 2.1 time: 0.063187 Jan 21 09:44:36.323014 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 574/1144] 10.222.0.45 () {58 vars in 1412 bytes} [Fri Jan 21 09:44:36 2022] GET /compute/v2.1/servers/daedf7bb-47ff-460d-bfb4-ac6166801f10/os-volume_attachments/b296c912-ef9d-40cb-a475-035245bb279f => generated 194 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 09:44:36.433747 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-082ee61f-8e0c-4df6-bd53-e15331fc1bc1 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d53a7fa2cb5498aa916817b82dba77e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515ded26ca114fbf9c6e920362aec64c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:44:36.444907 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-082ee61f-8e0c-4df6-bd53-e15331fc1bc1 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] 10.222.0.45 "GET /compute/v2.1/servers/325f56a1-8c36-43e5-9896-52f6713a7ba0" status: 200 len: 1276 microversion: 2.1 time: 0.214509 Jan 21 09:44:36.446216 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 571/1145] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:44:36 2022] GET /compute/v2.1/servers/325f56a1-8c36-43e5-9896-52f6713a7ba0 => generated 1276 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:44:37.467124 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-ddfc7cb1-48b7-4e4c-a423-8c6097fe3b45 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:44:37.467941 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-ddfc7cb1-48b7-4e4c-a423-8c6097fe3b45 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] [instance: 325f56a1-8c36-43e5-9896-52f6713a7ba0] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:44:37.475629 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-ddfc7cb1-48b7-4e4c-a423-8c6097fe3b45 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:44:37.476118 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-ddfc7cb1-48b7-4e4c-a423-8c6097fe3b45 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:44:37.476954 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-ddfc7cb1-48b7-4e4c-a423-8c6097fe3b45 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:44:37.477434 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-ddfc7cb1-48b7-4e4c-a423-8c6097fe3b45 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:44:37.658110 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-ddfc7cb1-48b7-4e4c-a423-8c6097fe3b45 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d53a7fa2cb5498aa916817b82dba77e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515ded26ca114fbf9c6e920362aec64c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:44:37.666657 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-ddfc7cb1-48b7-4e4c-a423-8c6097fe3b45 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] 10.222.0.45 "GET /compute/v2.1/servers/325f56a1-8c36-43e5-9896-52f6713a7ba0" status: 200 len: 1264 microversion: 2.1 time: 0.203300 Jan 21 09:44:37.667260 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 575/1146] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:44:37 2022] GET /compute/v2.1/servers/325f56a1-8c36-43e5-9896-52f6713a7ba0 => generated 1264 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:44:37.943163 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-01a96481-8f9d-4e68-9865-7667bc8b91f1 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0ad5e69d-468d-471c-8077-e897417f39b7"}} {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:44:37.944864 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-01a96481-8f9d-4e68-9865-7667bc8b91f1 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] [instance: daedf7bb-47ff-460d-bfb4-ac6166801f10] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:44:37.951540 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-01a96481-8f9d-4e68-9865-7667bc8b91f1 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:44:37.951984 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-01a96481-8f9d-4e68-9865-7667bc8b91f1 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:44:37.952769 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-01a96481-8f9d-4e68-9865-7667bc8b91f1 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:44:37.953236 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-01a96481-8f9d-4e68-9865-7667bc8b91f1 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:44:38.691091 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-655727c3-2332-4fe9-a518-dbb4e3f237fc tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:44:38.692047 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-655727c3-2332-4fe9-a518-dbb4e3f237fc tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] [instance: 325f56a1-8c36-43e5-9896-52f6713a7ba0] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:44:38.703192 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-655727c3-2332-4fe9-a518-dbb4e3f237fc tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:44:38.703629 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-655727c3-2332-4fe9-a518-dbb4e3f237fc tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:44:38.704431 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-655727c3-2332-4fe9-a518-dbb4e3f237fc tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:44:38.704869 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-655727c3-2332-4fe9-a518-dbb4e3f237fc tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:44:38.858407 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-655727c3-2332-4fe9-a518-dbb4e3f237fc tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d53a7fa2cb5498aa916817b82dba77e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515ded26ca114fbf9c6e920362aec64c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:44:38.866243 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-655727c3-2332-4fe9-a518-dbb4e3f237fc tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] 10.222.0.45 "GET /compute/v2.1/servers/325f56a1-8c36-43e5-9896-52f6713a7ba0" status: 200 len: 1264 microversion: 2.1 time: 0.178673 Jan 21 09:44:38.867134 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 576/1147] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:44:38 2022] GET /compute/v2.1/servers/325f56a1-8c36-43e5-9896-52f6713a7ba0 => generated 1264 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 09:44:39.509568 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-58a5fd81-cdff-4063-9b06-7e0f7054f996 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:44:39.510026 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-58a5fd81-cdff-4063-9b06-7e0f7054f996 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] [instance: f4a4e6b7-47b1-4de2-8677-4f8e3eb056c2] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:44:39.515969 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-58a5fd81-cdff-4063-9b06-7e0f7054f996 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:44:39.516408 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-58a5fd81-cdff-4063-9b06-7e0f7054f996 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:44:39.517224 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-58a5fd81-cdff-4063-9b06-7e0f7054f996 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:44:39.517661 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-58a5fd81-cdff-4063-9b06-7e0f7054f996 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:44:39.543459 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.objects.instance [None req-58a5fd81-cdff-4063-9b06-7e0f7054f996 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Lazy-loading 'flavor' on Instance uuid f4a4e6b7-47b1-4de2-8677-4f8e3eb056c2 {{(pid=123387) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 21 09:44:39.737031 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-01a96481-8f9d-4e68-9865-7667bc8b91f1 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] 10.222.0.45 "POST /compute/v2.1/servers/daedf7bb-47ff-460d-bfb4-ac6166801f10/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.797275 Jan 21 09:44:39.737977 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 572/1148] 10.222.0.45 () {60 vars in 1322 bytes} [Fri Jan 21 09:44:37 2022] POST /compute/v2.1/servers/daedf7bb-47ff-460d-bfb4-ac6166801f10/os-volume_attachments => generated 194 bytes in 1799 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 09:44:39.801050 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-58a5fd81-cdff-4063-9b06-7e0f7054f996 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] 10.222.0.45 "POST /compute/v2.1/servers/f4a4e6b7-47b1-4de2-8677-4f8e3eb056c2/action" status: 202 len: 0 microversion: 2.1 time: 0.295426 Jan 21 09:44:39.801882 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 577/1149] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Jan 21 09:44:39 2022] POST /compute/v2.1/servers/f4a4e6b7-47b1-4de2-8677-4f8e3eb056c2/action => generated 0 bytes in 297 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 21 09:44:39.811348 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-e2c9684f-05e0-4866-9aa9-9522fac4f851 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:44:39.812360 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-e2c9684f-05e0-4866-9aa9-9522fac4f851 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] [instance: f4a4e6b7-47b1-4de2-8677-4f8e3eb056c2] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:44:39.819748 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-e2c9684f-05e0-4866-9aa9-9522fac4f851 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:44:39.820798 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-e2c9684f-05e0-4866-9aa9-9522fac4f851 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:44:39.820968 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-e2c9684f-05e0-4866-9aa9-9522fac4f851 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:44:39.821426 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-e2c9684f-05e0-4866-9aa9-9522fac4f851 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:44:39.886100 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-40eb6c23-42be-4f8e-891a-7b2f6dfe0793 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:44:39.886859 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-40eb6c23-42be-4f8e-891a-7b2f6dfe0793 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] [instance: 325f56a1-8c36-43e5-9896-52f6713a7ba0] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:44:39.894624 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-40eb6c23-42be-4f8e-891a-7b2f6dfe0793 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:44:39.895084 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-40eb6c23-42be-4f8e-891a-7b2f6dfe0793 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:44:39.895911 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-40eb6c23-42be-4f8e-891a-7b2f6dfe0793 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:44:39.896730 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-40eb6c23-42be-4f8e-891a-7b2f6dfe0793 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:44:40.007246 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-e2c9684f-05e0-4866-9aa9-9522fac4f851 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aed8f68a416468cb303ae6c59a2203c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ac0334d1e14c29aa6222d547c64b00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:44:40.015792 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-e2c9684f-05e0-4866-9aa9-9522fac4f851 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] 10.222.0.45 "GET /compute/v2.1/servers/f4a4e6b7-47b1-4de2-8677-4f8e3eb056c2" status: 200 len: 1568 microversion: 2.1 time: 0.208461 Jan 21 09:44:40.016395 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 573/1150] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:44:39 2022] GET /compute/v2.1/servers/f4a4e6b7-47b1-4de2-8677-4f8e3eb056c2 => generated 1568 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:44:40.084680 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-40eb6c23-42be-4f8e-891a-7b2f6dfe0793 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d53a7fa2cb5498aa916817b82dba77e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515ded26ca114fbf9c6e920362aec64c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:44:40.092554 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-40eb6c23-42be-4f8e-891a-7b2f6dfe0793 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] 10.222.0.45 "GET /compute/v2.1/servers/325f56a1-8c36-43e5-9896-52f6713a7ba0" status: 200 len: 1264 microversion: 2.1 time: 0.212049 Jan 21 09:44:40.093225 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 578/1151] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:44:39 2022] GET /compute/v2.1/servers/325f56a1-8c36-43e5-9896-52f6713a7ba0 => generated 1264 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 09:44:41.034089 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-ad1970c4-7ecd-4ec9-a671-551d1624d323 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:44:41.034702 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-ad1970c4-7ecd-4ec9-a671-551d1624d323 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] [instance: f4a4e6b7-47b1-4de2-8677-4f8e3eb056c2] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:44:41.042289 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-ad1970c4-7ecd-4ec9-a671-551d1624d323 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:44:41.042734 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-ad1970c4-7ecd-4ec9-a671-551d1624d323 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:44:41.043537 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-ad1970c4-7ecd-4ec9-a671-551d1624d323 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:44:41.043981 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-ad1970c4-7ecd-4ec9-a671-551d1624d323 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:44:41.110082 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-df970efa-8824-4325-9845-ce10f888b234 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:44:41.110851 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-df970efa-8824-4325-9845-ce10f888b234 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] [instance: 325f56a1-8c36-43e5-9896-52f6713a7ba0] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:44:41.119835 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-df970efa-8824-4325-9845-ce10f888b234 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:44:41.120365 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-df970efa-8824-4325-9845-ce10f888b234 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:44:41.121287 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-df970efa-8824-4325-9845-ce10f888b234 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:44:41.121725 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-df970efa-8824-4325-9845-ce10f888b234 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:44:41.234086 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-ad1970c4-7ecd-4ec9-a671-551d1624d323 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aed8f68a416468cb303ae6c59a2203c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ac0334d1e14c29aa6222d547c64b00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:44:41.244512 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-ad1970c4-7ecd-4ec9-a671-551d1624d323 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] 10.222.0.45 "GET /compute/v2.1/servers/f4a4e6b7-47b1-4de2-8677-4f8e3eb056c2" status: 200 len: 1568 microversion: 2.1 time: 0.214066 Jan 21 09:44:41.245477 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 574/1152] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:44:41 2022] GET /compute/v2.1/servers/f4a4e6b7-47b1-4de2-8677-4f8e3eb056c2 => generated 1568 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:44:41.314355 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-df970efa-8824-4325-9845-ce10f888b234 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d53a7fa2cb5498aa916817b82dba77e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515ded26ca114fbf9c6e920362aec64c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:44:41.323864 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-df970efa-8824-4325-9845-ce10f888b234 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] 10.222.0.45 "GET /compute/v2.1/servers/325f56a1-8c36-43e5-9896-52f6713a7ba0" status: 200 len: 1264 microversion: 2.1 time: 0.217578 Jan 21 09:44:41.324411 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 579/1153] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:44:41 2022] GET /compute/v2.1/servers/325f56a1-8c36-43e5-9896-52f6713a7ba0 => generated 1264 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 09:44:42.267209 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-67892751-fd3a-4c33-8a22-5514adfd5a7c tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:44:42.267869 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-67892751-fd3a-4c33-8a22-5514adfd5a7c tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] [instance: f4a4e6b7-47b1-4de2-8677-4f8e3eb056c2] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:44:42.277652 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-67892751-fd3a-4c33-8a22-5514adfd5a7c tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:44:42.278472 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-67892751-fd3a-4c33-8a22-5514adfd5a7c tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:44:42.279990 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-67892751-fd3a-4c33-8a22-5514adfd5a7c tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:44:42.280854 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-67892751-fd3a-4c33-8a22-5514adfd5a7c tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:44:42.349851 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-fc81cef8-8756-42c9-9fe3-86996db6cb1d tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:44:42.351568 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-fc81cef8-8756-42c9-9fe3-86996db6cb1d tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] [instance: 325f56a1-8c36-43e5-9896-52f6713a7ba0] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:44:42.363882 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-fc81cef8-8756-42c9-9fe3-86996db6cb1d tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:44:42.366352 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-fc81cef8-8756-42c9-9fe3-86996db6cb1d tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:44:42.366352 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-fc81cef8-8756-42c9-9fe3-86996db6cb1d tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:44:42.367322 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-fc81cef8-8756-42c9-9fe3-86996db6cb1d tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:44:42.682819 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-67892751-fd3a-4c33-8a22-5514adfd5a7c tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aed8f68a416468cb303ae6c59a2203c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ac0334d1e14c29aa6222d547c64b00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:44:42.689762 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-fc81cef8-8756-42c9-9fe3-86996db6cb1d tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d53a7fa2cb5498aa916817b82dba77e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515ded26ca114fbf9c6e920362aec64c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:44:42.692546 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-67892751-fd3a-4c33-8a22-5514adfd5a7c tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] 10.222.0.45 "GET /compute/v2.1/servers/f4a4e6b7-47b1-4de2-8677-4f8e3eb056c2" status: 200 len: 1568 microversion: 2.1 time: 0.428882 Jan 21 09:44:42.694418 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 575/1154] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:44:42 2022] GET /compute/v2.1/servers/f4a4e6b7-47b1-4de2-8677-4f8e3eb056c2 => generated 1568 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:44:42.702712 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-fc81cef8-8756-42c9-9fe3-86996db6cb1d tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] 10.222.0.45 "GET /compute/v2.1/servers/325f56a1-8c36-43e5-9896-52f6713a7ba0" status: 200 len: 1264 microversion: 2.1 time: 0.364232 Jan 21 09:44:42.704041 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 580/1155] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:44:42 2022] GET /compute/v2.1/servers/325f56a1-8c36-43e5-9896-52f6713a7ba0 => generated 1264 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:44:43.715814 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-c81ae90a-3a22-4901-b725-b977fff5131b tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:44:43.716993 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-c81ae90a-3a22-4901-b725-b977fff5131b tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] [instance: f4a4e6b7-47b1-4de2-8677-4f8e3eb056c2] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:44:43.739175 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-3d727cae-200e-4791-9b75-1a1f8c565330 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:44:43.739175 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-3d727cae-200e-4791-9b75-1a1f8c565330 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] [instance: 325f56a1-8c36-43e5-9896-52f6713a7ba0] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:44:43.739783 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-c81ae90a-3a22-4901-b725-b977fff5131b tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:44:43.739783 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-c81ae90a-3a22-4901-b725-b977fff5131b tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:44:43.739783 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-c81ae90a-3a22-4901-b725-b977fff5131b tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:44:43.740606 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-3d727cae-200e-4791-9b75-1a1f8c565330 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:44:43.740725 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-c81ae90a-3a22-4901-b725-b977fff5131b tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:44:43.740823 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-3d727cae-200e-4791-9b75-1a1f8c565330 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:44:43.740823 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-3d727cae-200e-4791-9b75-1a1f8c565330 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:44:43.740823 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-3d727cae-200e-4791-9b75-1a1f8c565330 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:44:44.290585 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-3d727cae-200e-4791-9b75-1a1f8c565330 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d53a7fa2cb5498aa916817b82dba77e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515ded26ca114fbf9c6e920362aec64c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:44:44.301052 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-3d727cae-200e-4791-9b75-1a1f8c565330 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] 10.222.0.45 "GET /compute/v2.1/servers/325f56a1-8c36-43e5-9896-52f6713a7ba0" status: 200 len: 1264 microversion: 2.1 time: 0.579909 Jan 21 09:44:44.301359 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-c81ae90a-3a22-4901-b725-b977fff5131b tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aed8f68a416468cb303ae6c59a2203c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ac0334d1e14c29aa6222d547c64b00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:44:44.301972 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 581/1156] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:44:43 2022] GET /compute/v2.1/servers/325f56a1-8c36-43e5-9896-52f6713a7ba0 => generated 1264 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 09:44:44.317607 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-c81ae90a-3a22-4901-b725-b977fff5131b tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] 10.222.0.45 "GET /compute/v2.1/servers/f4a4e6b7-47b1-4de2-8677-4f8e3eb056c2" status: 200 len: 1568 microversion: 2.1 time: 0.608390 Jan 21 09:44:44.318714 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 576/1157] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:44:43 2022] GET /compute/v2.1/servers/f4a4e6b7-47b1-4de2-8677-4f8e3eb056c2 => generated 1568 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:44:45.325496 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-8360df8d-a640-4d3a-be6e-c34c887d2541 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:44:45.326276 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-8360df8d-a640-4d3a-be6e-c34c887d2541 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] [instance: 325f56a1-8c36-43e5-9896-52f6713a7ba0] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:44:45.333127 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-8360df8d-a640-4d3a-be6e-c34c887d2541 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:44:45.333612 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-8360df8d-a640-4d3a-be6e-c34c887d2541 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:44:45.335301 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-8360df8d-a640-4d3a-be6e-c34c887d2541 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:44:45.335847 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-8360df8d-a640-4d3a-be6e-c34c887d2541 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:44:45.335995 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-7d131645-edd9-49db-9a32-0f5c0ea77073 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:44:45.336685 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-7d131645-edd9-49db-9a32-0f5c0ea77073 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] [instance: f4a4e6b7-47b1-4de2-8677-4f8e3eb056c2] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:44:45.344153 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-7d131645-edd9-49db-9a32-0f5c0ea77073 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:44:45.344863 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-7d131645-edd9-49db-9a32-0f5c0ea77073 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:44:45.345890 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-7d131645-edd9-49db-9a32-0f5c0ea77073 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:44:45.346596 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-7d131645-edd9-49db-9a32-0f5c0ea77073 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:44:45.571755 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-8360df8d-a640-4d3a-be6e-c34c887d2541 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d53a7fa2cb5498aa916817b82dba77e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515ded26ca114fbf9c6e920362aec64c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:44:45.580065 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-8360df8d-a640-4d3a-be6e-c34c887d2541 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] 10.222.0.45 "GET /compute/v2.1/servers/325f56a1-8c36-43e5-9896-52f6713a7ba0" status: 200 len: 1264 microversion: 2.1 time: 0.258281 Jan 21 09:44:45.580229 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-7d131645-edd9-49db-9a32-0f5c0ea77073 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aed8f68a416468cb303ae6c59a2203c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ac0334d1e14c29aa6222d547c64b00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:44:45.580656 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 582/1158] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:44:45 2022] GET /compute/v2.1/servers/325f56a1-8c36-43e5-9896-52f6713a7ba0 => generated 1264 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:44:45.597657 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-7d131645-edd9-49db-9a32-0f5c0ea77073 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] 10.222.0.45 "GET /compute/v2.1/servers/f4a4e6b7-47b1-4de2-8677-4f8e3eb056c2" status: 200 len: 1568 microversion: 2.1 time: 0.266305 Jan 21 09:44:45.598295 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 577/1159] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:44:45 2022] GET /compute/v2.1/servers/f4a4e6b7-47b1-4de2-8677-4f8e3eb056c2 => generated 1568 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:44:46.600303 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-58146223-a293-485a-aecc-77219c5aeb27 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:44:46.601308 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-58146223-a293-485a-aecc-77219c5aeb27 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] [instance: 325f56a1-8c36-43e5-9896-52f6713a7ba0] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:44:46.610337 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-58146223-a293-485a-aecc-77219c5aeb27 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:44:46.610943 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-58146223-a293-485a-aecc-77219c5aeb27 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:44:46.611884 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-58146223-a293-485a-aecc-77219c5aeb27 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:44:46.612456 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-58146223-a293-485a-aecc-77219c5aeb27 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:44:46.621109 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-19b8ea9a-ba18-4c33-bf91-b4a56c500a50 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:44:46.621986 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-19b8ea9a-ba18-4c33-bf91-b4a56c500a50 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] [instance: f4a4e6b7-47b1-4de2-8677-4f8e3eb056c2] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:44:46.628660 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-19b8ea9a-ba18-4c33-bf91-b4a56c500a50 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:44:46.629124 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-19b8ea9a-ba18-4c33-bf91-b4a56c500a50 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:44:46.630018 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-19b8ea9a-ba18-4c33-bf91-b4a56c500a50 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:44:46.632330 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-19b8ea9a-ba18-4c33-bf91-b4a56c500a50 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:44:46.931289 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-58146223-a293-485a-aecc-77219c5aeb27 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d53a7fa2cb5498aa916817b82dba77e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515ded26ca114fbf9c6e920362aec64c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:44:46.948092 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-58146223-a293-485a-aecc-77219c5aeb27 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] 10.222.0.45 "GET /compute/v2.1/servers/325f56a1-8c36-43e5-9896-52f6713a7ba0" status: 200 len: 1264 microversion: 2.1 time: 0.353169 Jan 21 09:44:46.949383 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 583/1160] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:44:46 2022] GET /compute/v2.1/servers/325f56a1-8c36-43e5-9896-52f6713a7ba0 => generated 1264 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:44:46.956549 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-19b8ea9a-ba18-4c33-bf91-b4a56c500a50 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aed8f68a416468cb303ae6c59a2203c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ac0334d1e14c29aa6222d547c64b00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:44:46.966277 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-19b8ea9a-ba18-4c33-bf91-b4a56c500a50 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] 10.222.0.45 "GET /compute/v2.1/servers/f4a4e6b7-47b1-4de2-8677-4f8e3eb056c2" status: 200 len: 1568 microversion: 2.1 time: 0.349238 Jan 21 09:44:46.967317 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 578/1161] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:44:46 2022] GET /compute/v2.1/servers/f4a4e6b7-47b1-4de2-8677-4f8e3eb056c2 => generated 1568 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 09:44:47.056565 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [req-90330081-070a-499a-be93-4bb914b5060a req-f404357d-e1dc-4821-90b6-40c729694261 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "325f56a1-8c36-43e5-9896-52f6713a7ba0", "name": "network-vif-plugged", "status": "completed", "tag": "8a2eff4f-a260-4ac8-8540-0f38c10b4796"}]} {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:44:47.059353 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 21 09:44:47.059353 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: warnings.warn(msg) Jan 21 09:44:47.070944 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [req-90330081-070a-499a-be93-4bb914b5060a req-f404357d-e1dc-4821-90b6-40c729694261 service nova] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:44:47.071560 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [req-90330081-070a-499a-be93-4bb914b5060a req-f404357d-e1dc-4821-90b6-40c729694261 service nova] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:44:47.094273 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.compute.server_external_events [req-90330081-070a-499a-be93-4bb914b5060a req-f404357d-e1dc-4821-90b6-40c729694261 service nova] Creating event network-vif-plugged:8a2eff4f-a260-4ac8-8540-0f38c10b4796 for instance 325f56a1-8c36-43e5-9896-52f6713a7ba0 on hv-cinder-80403 Jan 21 09:44:47.102614 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [req-90330081-070a-499a-be93-4bb914b5060a req-f404357d-e1dc-4821-90b6-40c729694261 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053250 Jan 21 09:44:47.103489 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 584/1162] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Jan 21 09:44:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 09:44:47.971570 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-7f23ad9a-d387-4ccc-8670-82f82db04dbc tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:44:47.972225 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-7f23ad9a-d387-4ccc-8670-82f82db04dbc tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] [instance: 325f56a1-8c36-43e5-9896-52f6713a7ba0] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:44:47.980038 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-7f23ad9a-d387-4ccc-8670-82f82db04dbc tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:44:47.980845 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-7f23ad9a-d387-4ccc-8670-82f82db04dbc tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:44:47.981400 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-7f23ad9a-d387-4ccc-8670-82f82db04dbc tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:44:47.981835 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-7f23ad9a-d387-4ccc-8670-82f82db04dbc tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:44:47.989896 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-9b70bb61-9af9-4729-b079-ec6afc5f4d32 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:44:47.991201 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-9b70bb61-9af9-4729-b079-ec6afc5f4d32 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] [instance: f4a4e6b7-47b1-4de2-8677-4f8e3eb056c2] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:44:48.000097 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-9b70bb61-9af9-4729-b079-ec6afc5f4d32 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:44:48.000851 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-9b70bb61-9af9-4729-b079-ec6afc5f4d32 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:44:48.002545 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-9b70bb61-9af9-4729-b079-ec6afc5f4d32 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:44:48.003172 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-9b70bb61-9af9-4729-b079-ec6afc5f4d32 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:44:48.276735 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-7f23ad9a-d387-4ccc-8670-82f82db04dbc tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d53a7fa2cb5498aa916817b82dba77e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515ded26ca114fbf9c6e920362aec64c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:44:48.280434 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-9b70bb61-9af9-4729-b079-ec6afc5f4d32 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aed8f68a416468cb303ae6c59a2203c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ac0334d1e14c29aa6222d547c64b00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:44:48.295439 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-9b70bb61-9af9-4729-b079-ec6afc5f4d32 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] 10.222.0.45 "GET /compute/v2.1/servers/f4a4e6b7-47b1-4de2-8677-4f8e3eb056c2" status: 200 len: 1568 microversion: 2.1 time: 0.312036 Jan 21 09:44:48.296572 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 585/1163] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:44:47 2022] GET /compute/v2.1/servers/f4a4e6b7-47b1-4de2-8677-4f8e3eb056c2 => generated 1568 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:44:48.311987 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-7f23ad9a-d387-4ccc-8670-82f82db04dbc tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] 10.222.0.45 "GET /compute/v2.1/servers/325f56a1-8c36-43e5-9896-52f6713a7ba0" status: 200 len: 1264 microversion: 2.1 time: 0.343593 Jan 21 09:44:48.313530 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 579/1164] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:44:47 2022] GET /compute/v2.1/servers/325f56a1-8c36-43e5-9896-52f6713a7ba0 => generated 1264 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:44:49.319286 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-e43f1213-a077-43bc-b608-323e94465b3f tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:44:49.323230 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-e43f1213-a077-43bc-b608-323e94465b3f tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] [instance: f4a4e6b7-47b1-4de2-8677-4f8e3eb056c2] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:44:49.327030 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-e43f1213-a077-43bc-b608-323e94465b3f tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:44:49.327476 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-e43f1213-a077-43bc-b608-323e94465b3f tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:44:49.328277 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-e43f1213-a077-43bc-b608-323e94465b3f tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:44:49.328710 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-e43f1213-a077-43bc-b608-323e94465b3f tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:44:49.338178 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-37382d3b-26ab-44f2-baef-f0c614a1a499 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:44:49.339005 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-37382d3b-26ab-44f2-baef-f0c614a1a499 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] [instance: 325f56a1-8c36-43e5-9896-52f6713a7ba0] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:44:49.346329 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-37382d3b-26ab-44f2-baef-f0c614a1a499 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:44:49.347094 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-37382d3b-26ab-44f2-baef-f0c614a1a499 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:44:49.348058 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-37382d3b-26ab-44f2-baef-f0c614a1a499 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:44:49.348889 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-37382d3b-26ab-44f2-baef-f0c614a1a499 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:44:49.645469 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-e43f1213-a077-43bc-b608-323e94465b3f tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aed8f68a416468cb303ae6c59a2203c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ac0334d1e14c29aa6222d547c64b00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:44:49.658224 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-e43f1213-a077-43bc-b608-323e94465b3f tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] 10.222.0.45 "GET /compute/v2.1/servers/f4a4e6b7-47b1-4de2-8677-4f8e3eb056c2" status: 200 len: 1568 microversion: 2.1 time: 0.342622 Jan 21 09:44:49.672432 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 586/1165] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:44:49 2022] GET /compute/v2.1/servers/f4a4e6b7-47b1-4de2-8677-4f8e3eb056c2 => generated 1568 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 09:44:49.672432 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-388ab15c-7eb5-4e6b-b57c-70362932ce55 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:44:49.672432 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-388ab15c-7eb5-4e6b-b57c-70362932ce55 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] [instance: daedf7bb-47ff-460d-bfb4-ac6166801f10] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:44:49.674060 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-37382d3b-26ab-44f2-baef-f0c614a1a499 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d53a7fa2cb5498aa916817b82dba77e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515ded26ca114fbf9c6e920362aec64c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:44:49.679877 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-388ab15c-7eb5-4e6b-b57c-70362932ce55 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:44:49.680186 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-37382d3b-26ab-44f2-baef-f0c614a1a499 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] 10.222.0.45 "GET /compute/v2.1/servers/325f56a1-8c36-43e5-9896-52f6713a7ba0" status: 200 len: 1452 microversion: 2.1 time: 0.346395 Jan 21 09:44:49.680606 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-388ab15c-7eb5-4e6b-b57c-70362932ce55 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:44:49.682292 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-388ab15c-7eb5-4e6b-b57c-70362932ce55 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:44:49.683139 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-388ab15c-7eb5-4e6b-b57c-70362932ce55 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:44:49.684804 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 580/1166] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:44:49 2022] GET /compute/v2.1/servers/325f56a1-8c36-43e5-9896-52f6713a7ba0 => generated 1452 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:44:49.703230 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-370fb5e6-9c96-4c7e-ab21-0d1faf8cee84 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:44:49.704800 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-370fb5e6-9c96-4c7e-ab21-0d1faf8cee84 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] [instance: 325f56a1-8c36-43e5-9896-52f6713a7ba0] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:44:49.713812 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-370fb5e6-9c96-4c7e-ab21-0d1faf8cee84 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:44:49.715045 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-370fb5e6-9c96-4c7e-ab21-0d1faf8cee84 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:44:49.715985 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-370fb5e6-9c96-4c7e-ab21-0d1faf8cee84 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:44:49.716425 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-370fb5e6-9c96-4c7e-ab21-0d1faf8cee84 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:44:49.727026 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-388ab15c-7eb5-4e6b-b57c-70362932ce55 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] 10.222.0.45 "GET /compute/v2.1/servers/daedf7bb-47ff-460d-bfb4-ac6166801f10/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.066382 Jan 21 09:44:49.728015 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 587/1167] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Jan 21 09:44:49 2022] GET /compute/v2.1/servers/daedf7bb-47ff-460d-bfb4-ac6166801f10/os-volume_attachments => generated 371 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 09:44:49.912937 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-370fb5e6-9c96-4c7e-ab21-0d1faf8cee84 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d53a7fa2cb5498aa916817b82dba77e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515ded26ca114fbf9c6e920362aec64c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:44:49.922012 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-370fb5e6-9c96-4c7e-ab21-0d1faf8cee84 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] 10.222.0.45 "GET /compute/v2.1/servers/325f56a1-8c36-43e5-9896-52f6713a7ba0" status: 200 len: 1452 microversion: 2.1 time: 0.223234 Jan 21 09:44:49.922749 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 581/1168] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:44:49 2022] GET /compute/v2.1/servers/325f56a1-8c36-43e5-9896-52f6713a7ba0 => generated 1452 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:44:50.008240 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-c1c368e3-b201-4f74-8652-ef44c7db4583 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:44:50.009072 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-c1c368e3-b201-4f74-8652-ef44c7db4583 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] [instance: daedf7bb-47ff-460d-bfb4-ac6166801f10] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:44:50.016075 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-c1c368e3-b201-4f74-8652-ef44c7db4583 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:44:50.016480 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-c1c368e3-b201-4f74-8652-ef44c7db4583 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:44:50.017333 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-c1c368e3-b201-4f74-8652-ef44c7db4583 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:44:50.017955 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-c1c368e3-b201-4f74-8652-ef44c7db4583 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:44:50.066942 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-c1c368e3-b201-4f74-8652-ef44c7db4583 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] 10.222.0.45 "GET /compute/v2.1/servers/daedf7bb-47ff-460d-bfb4-ac6166801f10/os-volume_attachments/b296c912-ef9d-40cb-a475-035245bb279f" status: 200 len: 194 microversion: 2.1 time: 0.062586 Jan 21 09:44:50.072449 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 588/1169] 10.222.0.45 () {58 vars in 1412 bytes} [Fri Jan 21 09:44:50 2022] GET /compute/v2.1/servers/daedf7bb-47ff-460d-bfb4-ac6166801f10/os-volume_attachments/b296c912-ef9d-40cb-a475-035245bb279f => generated 194 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 21 09:44:50.078519 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-452799ba-bfc8-45a8-b0f0-1fe86daf0be6 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:44:50.079009 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-452799ba-bfc8-45a8-b0f0-1fe86daf0be6 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] [instance: daedf7bb-47ff-460d-bfb4-ac6166801f10] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:44:50.086158 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-452799ba-bfc8-45a8-b0f0-1fe86daf0be6 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:44:50.086846 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-452799ba-bfc8-45a8-b0f0-1fe86daf0be6 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:44:50.087814 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-452799ba-bfc8-45a8-b0f0-1fe86daf0be6 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:44:50.088586 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-452799ba-bfc8-45a8-b0f0-1fe86daf0be6 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:44:50.194483 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.objects.instance [None req-452799ba-bfc8-45a8-b0f0-1fe86daf0be6 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lazy-loading 'services' on Instance uuid daedf7bb-47ff-460d-bfb4-ac6166801f10 {{(pid=123386) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 21 09:44:50.573107 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-452799ba-bfc8-45a8-b0f0-1fe86daf0be6 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] 10.222.0.45 "DELETE /compute/v2.1/servers/daedf7bb-47ff-460d-bfb4-ac6166801f10/os-volume_attachments/b296c912-ef9d-40cb-a475-035245bb279f" status: 202 len: 0 microversion: 2.1 time: 0.498039 Jan 21 09:44:50.573889 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 582/1170] 10.222.0.45 () {58 vars in 1415 bytes} [Fri Jan 21 09:44:50 2022] DELETE /compute/v2.1/servers/daedf7bb-47ff-460d-bfb4-ac6166801f10/os-volume_attachments/b296c912-ef9d-40cb-a475-035245bb279f => generated 0 bytes in 500 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 21 09:44:50.687660 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-5e923e70-0185-4abe-9eaf-ed8df1d7e0c5 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:44:50.688598 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-5e923e70-0185-4abe-9eaf-ed8df1d7e0c5 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] [instance: f4a4e6b7-47b1-4de2-8677-4f8e3eb056c2] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:44:50.696863 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-5e923e70-0185-4abe-9eaf-ed8df1d7e0c5 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:44:50.697562 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-5e923e70-0185-4abe-9eaf-ed8df1d7e0c5 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:44:50.698482 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-5e923e70-0185-4abe-9eaf-ed8df1d7e0c5 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:44:50.698927 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-5e923e70-0185-4abe-9eaf-ed8df1d7e0c5 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:44:50.948765 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-5e923e70-0185-4abe-9eaf-ed8df1d7e0c5 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aed8f68a416468cb303ae6c59a2203c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ac0334d1e14c29aa6222d547c64b00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:44:50.957660 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-5e923e70-0185-4abe-9eaf-ed8df1d7e0c5 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] 10.222.0.45 "GET /compute/v2.1/servers/f4a4e6b7-47b1-4de2-8677-4f8e3eb056c2" status: 200 len: 1568 microversion: 2.1 time: 0.274076 Jan 21 09:44:50.958251 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 589/1171] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:44:50 2022] GET /compute/v2.1/servers/f4a4e6b7-47b1-4de2-8677-4f8e3eb056c2 => generated 1568 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:44:51.983078 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-ebe5625d-8142-4d4b-afe1-b3e72bece684 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:44:51.984992 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-ebe5625d-8142-4d4b-afe1-b3e72bece684 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] [instance: f4a4e6b7-47b1-4de2-8677-4f8e3eb056c2] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:44:51.996475 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-ebe5625d-8142-4d4b-afe1-b3e72bece684 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:44:51.997321 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-ebe5625d-8142-4d4b-afe1-b3e72bece684 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:44:51.998752 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-ebe5625d-8142-4d4b-afe1-b3e72bece684 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:44:51.999624 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-ebe5625d-8142-4d4b-afe1-b3e72bece684 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:44:52.458187 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-ebe5625d-8142-4d4b-afe1-b3e72bece684 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aed8f68a416468cb303ae6c59a2203c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ac0334d1e14c29aa6222d547c64b00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:44:52.471407 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-ebe5625d-8142-4d4b-afe1-b3e72bece684 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] 10.222.0.45 "GET /compute/v2.1/servers/f4a4e6b7-47b1-4de2-8677-4f8e3eb056c2" status: 200 len: 1568 microversion: 2.1 time: 0.497333 Jan 21 09:44:52.472442 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 583/1172] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:44:51 2022] GET /compute/v2.1/servers/f4a4e6b7-47b1-4de2-8677-4f8e3eb056c2 => generated 1568 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:44:52.859017 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-9df8f580-0156-4fbb-bb24-720d71a27139 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:44:52.859783 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-9df8f580-0156-4fbb-bb24-720d71a27139 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] [instance: daedf7bb-47ff-460d-bfb4-ac6166801f10] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:44:52.867164 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-9df8f580-0156-4fbb-bb24-720d71a27139 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:44:52.867719 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-9df8f580-0156-4fbb-bb24-720d71a27139 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:44:52.868589 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-9df8f580-0156-4fbb-bb24-720d71a27139 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:44:52.869264 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-9df8f580-0156-4fbb-bb24-720d71a27139 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:44:52.910941 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-9df8f580-0156-4fbb-bb24-720d71a27139 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] 10.222.0.45 "GET /compute/v2.1/servers/daedf7bb-47ff-460d-bfb4-ac6166801f10/os-volume_attachments/0ad5e69d-468d-471c-8077-e897417f39b7" status: 200 len: 194 microversion: 2.1 time: 0.056114 Jan 21 09:44:52.912328 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 590/1173] 10.222.0.45 () {58 vars in 1412 bytes} [Fri Jan 21 09:44:52 2022] GET /compute/v2.1/servers/daedf7bb-47ff-460d-bfb4-ac6166801f10/os-volume_attachments/0ad5e69d-468d-471c-8077-e897417f39b7 => generated 194 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 21 09:44:52.924115 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-a8f530bf-18ed-455e-b7e0-1985aba9c9a6 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:44:52.924621 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-a8f530bf-18ed-455e-b7e0-1985aba9c9a6 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] [instance: daedf7bb-47ff-460d-bfb4-ac6166801f10] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:44:52.933126 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-a8f530bf-18ed-455e-b7e0-1985aba9c9a6 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:44:52.933605 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-a8f530bf-18ed-455e-b7e0-1985aba9c9a6 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:44:52.937210 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-a8f530bf-18ed-455e-b7e0-1985aba9c9a6 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:44:52.937210 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-a8f530bf-18ed-455e-b7e0-1985aba9c9a6 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:44:53.066305 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.objects.instance [None req-a8f530bf-18ed-455e-b7e0-1985aba9c9a6 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lazy-loading 'services' on Instance uuid daedf7bb-47ff-460d-bfb4-ac6166801f10 {{(pid=123386) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 21 09:44:53.403459 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-a8f530bf-18ed-455e-b7e0-1985aba9c9a6 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] 10.222.0.45 "DELETE /compute/v2.1/servers/daedf7bb-47ff-460d-bfb4-ac6166801f10/os-volume_attachments/0ad5e69d-468d-471c-8077-e897417f39b7" status: 202 len: 0 microversion: 2.1 time: 0.482368 Jan 21 09:44:53.404664 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 584/1174] 10.222.0.45 () {58 vars in 1415 bytes} [Fri Jan 21 09:44:52 2022] DELETE /compute/v2.1/servers/daedf7bb-47ff-460d-bfb4-ac6166801f10/os-volume_attachments/0ad5e69d-468d-471c-8077-e897417f39b7 => generated 0 bytes in 485 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 21 09:44:53.502824 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-e9bae18d-4be2-4677-90aa-1f9bf0585ad3 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:44:53.504610 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-e9bae18d-4be2-4677-90aa-1f9bf0585ad3 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] [instance: f4a4e6b7-47b1-4de2-8677-4f8e3eb056c2] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:44:53.519553 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-e9bae18d-4be2-4677-90aa-1f9bf0585ad3 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:44:53.520930 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-e9bae18d-4be2-4677-90aa-1f9bf0585ad3 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:44:53.522787 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-e9bae18d-4be2-4677-90aa-1f9bf0585ad3 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:44:53.524537 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-e9bae18d-4be2-4677-90aa-1f9bf0585ad3 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:44:53.938117 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-e9bae18d-4be2-4677-90aa-1f9bf0585ad3 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aed8f68a416468cb303ae6c59a2203c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ac0334d1e14c29aa6222d547c64b00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:44:53.959612 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-e9bae18d-4be2-4677-90aa-1f9bf0585ad3 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] 10.222.0.45 "GET /compute/v2.1/servers/f4a4e6b7-47b1-4de2-8677-4f8e3eb056c2" status: 200 len: 1568 microversion: 2.1 time: 0.464655 Jan 21 09:44:53.962254 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 591/1175] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:44:53 2022] GET /compute/v2.1/servers/f4a4e6b7-47b1-4de2-8677-4f8e3eb056c2 => generated 1568 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:44:54.183361 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [req-fd958bb4-c2ea-481f-9350-85b6f7c0b918 req-dcf87d39-791b-4f5d-a796-11d2dda65948 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "325f56a1-8c36-43e5-9896-52f6713a7ba0", "tag": "8a2eff4f-a260-4ac8-8540-0f38c10b4796"}]} {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:44:54.185950 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 21 09:44:54.185950 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: warnings.warn(msg) Jan 21 09:44:54.196425 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [req-fd958bb4-c2ea-481f-9350-85b6f7c0b918 req-dcf87d39-791b-4f5d-a796-11d2dda65948 service nova] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:44:54.197486 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [req-fd958bb4-c2ea-481f-9350-85b6f7c0b918 req-dcf87d39-791b-4f5d-a796-11d2dda65948 service nova] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:44:54.214033 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.compute.server_external_events [req-fd958bb4-c2ea-481f-9350-85b6f7c0b918 req-dcf87d39-791b-4f5d-a796-11d2dda65948 service nova] Creating event network-changed:8a2eff4f-a260-4ac8-8540-0f38c10b4796 for instance 325f56a1-8c36-43e5-9896-52f6713a7ba0 on hv-cinder-80403 Jan 21 09:44:54.220816 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [req-fd958bb4-c2ea-481f-9350-85b6f7c0b918 req-dcf87d39-791b-4f5d-a796-11d2dda65948 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043582 Jan 21 09:44:54.222356 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 585/1176] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Jan 21 09:44:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 09:44:54.993201 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-c5dd41e8-0cc0-4903-af08-04a2129a5793 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:44:54.993868 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-c5dd41e8-0cc0-4903-af08-04a2129a5793 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] [instance: f4a4e6b7-47b1-4de2-8677-4f8e3eb056c2] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:44:55.005295 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-c5dd41e8-0cc0-4903-af08-04a2129a5793 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:44:55.013358 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-c5dd41e8-0cc0-4903-af08-04a2129a5793 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:44:55.014576 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-c5dd41e8-0cc0-4903-af08-04a2129a5793 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:44:55.015248 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-c5dd41e8-0cc0-4903-af08-04a2129a5793 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:44:55.281227 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-c5dd41e8-0cc0-4903-af08-04a2129a5793 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aed8f68a416468cb303ae6c59a2203c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ac0334d1e14c29aa6222d547c64b00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:44:55.296493 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-c5dd41e8-0cc0-4903-af08-04a2129a5793 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] 10.222.0.45 "GET /compute/v2.1/servers/f4a4e6b7-47b1-4de2-8677-4f8e3eb056c2" status: 200 len: 1568 microversion: 2.1 time: 0.311636 Jan 21 09:44:55.297589 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 592/1177] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:44:54 2022] GET /compute/v2.1/servers/f4a4e6b7-47b1-4de2-8677-4f8e3eb056c2 => generated 1568 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:44:55.935454 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-a86c384c-d3a8-4735-a552-9548f63fd567 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:44:55.936395 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-a86c384c-d3a8-4735-a552-9548f63fd567 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] [instance: daedf7bb-47ff-460d-bfb4-ac6166801f10] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:44:55.943960 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-a86c384c-d3a8-4735-a552-9548f63fd567 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:44:55.943960 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-a86c384c-d3a8-4735-a552-9548f63fd567 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:44:55.944732 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-a86c384c-d3a8-4735-a552-9548f63fd567 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:44:55.945271 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-a86c384c-d3a8-4735-a552-9548f63fd567 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:44:55.984101 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-a86c384c-d3a8-4735-a552-9548f63fd567 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] 10.222.0.45 "GET /compute/v2.1/servers/daedf7bb-47ff-460d-bfb4-ac6166801f10/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051325 Jan 21 09:44:55.984101 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 586/1178] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Jan 21 09:44:55 2022] GET /compute/v2.1/servers/daedf7bb-47ff-460d-bfb4-ac6166801f10/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jan 21 09:44:56.120482 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-d6019822-9af5-40e7-a203-256c411bf0a5 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:44:56.122394 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-d6019822-9af5-40e7-a203-256c411bf0a5 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] [instance: daedf7bb-47ff-460d-bfb4-ac6166801f10] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:44:56.133965 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-d6019822-9af5-40e7-a203-256c411bf0a5 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:44:56.134751 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-d6019822-9af5-40e7-a203-256c411bf0a5 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:44:56.136184 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-d6019822-9af5-40e7-a203-256c411bf0a5 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:44:56.136948 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-d6019822-9af5-40e7-a203-256c411bf0a5 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:44:56.180934 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-d6019822-9af5-40e7-a203-256c411bf0a5 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] 10.222.0.45 "GET /compute/v2.1/servers/daedf7bb-47ff-460d-bfb4-ac6166801f10/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.067649 Jan 21 09:44:56.181660 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 593/1179] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Jan 21 09:44:56 2022] GET /compute/v2.1/servers/daedf7bb-47ff-460d-bfb4-ac6166801f10/os-volume_attachments => generated 25 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jan 21 09:44:56.248294 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-eb0652e5-4f58-4ad4-8645-8032500b6867 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:44:56.248809 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-eb0652e5-4f58-4ad4-8645-8032500b6867 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] [instance: daedf7bb-47ff-460d-bfb4-ac6166801f10] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:44:56.261423 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-eb0652e5-4f58-4ad4-8645-8032500b6867 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:44:56.262267 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-eb0652e5-4f58-4ad4-8645-8032500b6867 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:44:56.263966 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-eb0652e5-4f58-4ad4-8645-8032500b6867 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:44:56.264667 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-eb0652e5-4f58-4ad4-8645-8032500b6867 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:44:56.305047 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-eb0652e5-4f58-4ad4-8645-8032500b6867 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] [instance: daedf7bb-47ff-460d-bfb4-ac6166801f10] Going to try to terminate instance {{(pid=123386) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 21 09:44:56.320416 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-820d0e5b-d35f-478d-be22-b8eae57ea4b6 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:44:56.321486 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-820d0e5b-d35f-478d-be22-b8eae57ea4b6 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] [instance: f4a4e6b7-47b1-4de2-8677-4f8e3eb056c2] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:44:56.332359 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-820d0e5b-d35f-478d-be22-b8eae57ea4b6 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:44:56.333318 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-820d0e5b-d35f-478d-be22-b8eae57ea4b6 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:44:56.335639 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-820d0e5b-d35f-478d-be22-b8eae57ea4b6 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:44:56.336476 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-820d0e5b-d35f-478d-be22-b8eae57ea4b6 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:44:56.490898 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-820d0e5b-d35f-478d-be22-b8eae57ea4b6 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aed8f68a416468cb303ae6c59a2203c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ac0334d1e14c29aa6222d547c64b00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:44:56.501837 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-820d0e5b-d35f-478d-be22-b8eae57ea4b6 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] 10.222.0.45 "GET /compute/v2.1/servers/f4a4e6b7-47b1-4de2-8677-4f8e3eb056c2" status: 200 len: 1509 microversion: 2.1 time: 0.188609 Jan 21 09:44:56.502450 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 594/1180] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:44:56 2022] GET /compute/v2.1/servers/f4a4e6b7-47b1-4de2-8677-4f8e3eb056c2 => generated 1509 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:44:56.519823 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-4dc24744-e673-46c2-8776-c0cc19e07e11 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:44:56.520421 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-4dc24744-e673-46c2-8776-c0cc19e07e11 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] [instance: f4a4e6b7-47b1-4de2-8677-4f8e3eb056c2] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:44:56.527316 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-4dc24744-e673-46c2-8776-c0cc19e07e11 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:44:56.527765 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-4dc24744-e673-46c2-8776-c0cc19e07e11 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:44:56.528551 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-4dc24744-e673-46c2-8776-c0cc19e07e11 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:44:56.528984 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-4dc24744-e673-46c2-8776-c0cc19e07e11 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:44:56.699485 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-eb0652e5-4f58-4ad4-8645-8032500b6867 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] 10.222.0.45 "DELETE /compute/v2.1/servers/daedf7bb-47ff-460d-bfb4-ac6166801f10" status: 204 len: 0 microversion: 2.1 time: 0.454024 Jan 21 09:44:56.700532 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 587/1181] 10.222.0.45 () {58 vars in 1238 bytes} [Fri Jan 21 09:44:56 2022] DELETE /compute/v2.1/servers/daedf7bb-47ff-460d-bfb4-ac6166801f10 => generated 0 bytes in 456 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jan 21 09:44:56.710081 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-11ca083f-0a0f-46b7-bead-bd4adb397200 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:44:56.710893 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-11ca083f-0a0f-46b7-bead-bd4adb397200 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] [instance: daedf7bb-47ff-460d-bfb4-ac6166801f10] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:44:56.718349 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-11ca083f-0a0f-46b7-bead-bd4adb397200 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:44:56.718799 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-11ca083f-0a0f-46b7-bead-bd4adb397200 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:44:56.719611 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-11ca083f-0a0f-46b7-bead-bd4adb397200 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:44:56.720050 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-11ca083f-0a0f-46b7-bead-bd4adb397200 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:44:56.843932 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-4dc24744-e673-46c2-8776-c0cc19e07e11 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] 10.222.0.45 "POST /compute/v2.1/servers/f4a4e6b7-47b1-4de2-8677-4f8e3eb056c2/action" status: 202 len: 0 microversion: 2.1 time: 0.327815 Jan 21 09:44:56.845226 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 595/1182] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Jan 21 09:44:56 2022] POST /compute/v2.1/servers/f4a4e6b7-47b1-4de2-8677-4f8e3eb056c2/action => generated 0 bytes in 330 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jan 21 09:44:56.857815 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-34649947-cce2-457f-ac41-9e56892cc4c5 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:44:56.861468 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-34649947-cce2-457f-ac41-9e56892cc4c5 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] [instance: f4a4e6b7-47b1-4de2-8677-4f8e3eb056c2] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:44:56.870500 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-34649947-cce2-457f-ac41-9e56892cc4c5 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:44:56.871354 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-34649947-cce2-457f-ac41-9e56892cc4c5 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:44:56.872743 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-34649947-cce2-457f-ac41-9e56892cc4c5 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:44:56.873856 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-34649947-cce2-457f-ac41-9e56892cc4c5 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:44:56.921410 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-11ca083f-0a0f-46b7-bead-bd4adb397200 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '590e721135c84df5946147ac7e944fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2322cb784615409bb15a6f49522d3b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:44:56.930583 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-11ca083f-0a0f-46b7-bead-bd4adb397200 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] 10.222.0.45 "GET /compute/v2.1/servers/daedf7bb-47ff-460d-bfb4-ac6166801f10" status: 200 len: 1672 microversion: 2.1 time: 0.225221 Jan 21 09:44:56.931180 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 588/1183] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:44:56 2022] GET /compute/v2.1/servers/daedf7bb-47ff-460d-bfb4-ac6166801f10 => generated 1672 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:44:56.936135 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [req-47c61edb-7d88-4329-a6a5-65730ca130f4 req-56ae44ed-dd68-4499-9fae-0d3d9639f5eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4a4e6b7-47b1-4de2-8677-4f8e3eb056c2", "name": "network-vif-unplugged", "status": "completed", "tag": "0e43678c-54de-414e-81b5-5773897a97f4"}]} {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:44:56.938707 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 21 09:44:56.938707 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: warnings.warn(msg) Jan 21 09:44:56.948666 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [req-47c61edb-7d88-4329-a6a5-65730ca130f4 req-56ae44ed-dd68-4499-9fae-0d3d9639f5eb service nova] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:44:56.949111 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [req-47c61edb-7d88-4329-a6a5-65730ca130f4 req-56ae44ed-dd68-4499-9fae-0d3d9639f5eb service nova] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:44:56.968706 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.compute.server_external_events [req-47c61edb-7d88-4329-a6a5-65730ca130f4 req-56ae44ed-dd68-4499-9fae-0d3d9639f5eb service nova] Unable to find a host for instance f4a4e6b7-47b1-4de2-8677-4f8e3eb056c2. Dropping event network-vif-unplugged {{(pid=123386) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Jan 21 09:44:56.970259 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [req-47c61edb-7d88-4329-a6a5-65730ca130f4 req-56ae44ed-dd68-4499-9fae-0d3d9639f5eb service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.037697 Jan 21 09:44:56.971191 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 589/1184] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Jan 21 09:44:56 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 39 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jan 21 09:44:57.054611 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-34649947-cce2-457f-ac41-9e56892cc4c5 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aed8f68a416468cb303ae6c59a2203c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ac0334d1e14c29aa6222d547c64b00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:44:57.065610 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-34649947-cce2-457f-ac41-9e56892cc4c5 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] 10.222.0.45 "GET /compute/v2.1/servers/f4a4e6b7-47b1-4de2-8677-4f8e3eb056c2" status: 200 len: 1517 microversion: 2.1 time: 0.216317 Jan 21 09:44:57.067073 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 596/1185] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:44:56 2022] GET /compute/v2.1/servers/f4a4e6b7-47b1-4de2-8677-4f8e3eb056c2 => generated 1517 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:44:57.957104 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-08ea31d8-d335-4329-8aa2-9bab7ea47bc1 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:44:57.958004 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-08ea31d8-d335-4329-8aa2-9bab7ea47bc1 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] [instance: daedf7bb-47ff-460d-bfb4-ac6166801f10] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:44:57.965947 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-08ea31d8-d335-4329-8aa2-9bab7ea47bc1 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:44:57.966512 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-08ea31d8-d335-4329-8aa2-9bab7ea47bc1 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:44:57.967215 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-08ea31d8-d335-4329-8aa2-9bab7ea47bc1 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:44:57.967652 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-08ea31d8-d335-4329-8aa2-9bab7ea47bc1 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:44:58.084685 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-bc2b29f2-5716-4989-8af2-8e361d44facf tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:44:58.085590 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-bc2b29f2-5716-4989-8af2-8e361d44facf tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] [instance: f4a4e6b7-47b1-4de2-8677-4f8e3eb056c2] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:44:58.092866 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-bc2b29f2-5716-4989-8af2-8e361d44facf tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:44:58.093498 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-bc2b29f2-5716-4989-8af2-8e361d44facf tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:44:58.094397 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-bc2b29f2-5716-4989-8af2-8e361d44facf tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:44:58.094921 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-bc2b29f2-5716-4989-8af2-8e361d44facf tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:44:58.189281 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-08ea31d8-d335-4329-8aa2-9bab7ea47bc1 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '590e721135c84df5946147ac7e944fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2322cb784615409bb15a6f49522d3b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:44:58.200896 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-08ea31d8-d335-4329-8aa2-9bab7ea47bc1 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] 10.222.0.45 "GET /compute/v2.1/servers/daedf7bb-47ff-460d-bfb4-ac6166801f10" status: 200 len: 1672 microversion: 2.1 time: 0.247590 Jan 21 09:44:58.213113 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 590/1186] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:44:57 2022] GET /compute/v2.1/servers/daedf7bb-47ff-460d-bfb4-ac6166801f10 => generated 1672 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:44:58.287383 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-bc2b29f2-5716-4989-8af2-8e361d44facf tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aed8f68a416468cb303ae6c59a2203c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ac0334d1e14c29aa6222d547c64b00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:44:58.299988 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-bc2b29f2-5716-4989-8af2-8e361d44facf tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] 10.222.0.45 "GET /compute/v2.1/servers/f4a4e6b7-47b1-4de2-8677-4f8e3eb056c2" status: 200 len: 1517 microversion: 2.1 time: 0.219744 Jan 21 09:44:58.301132 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 597/1187] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:44:58 2022] GET /compute/v2.1/servers/f4a4e6b7-47b1-4de2-8677-4f8e3eb056c2 => generated 1517 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 09:44:59.221703 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-01e307fe-f18a-40b5-837f-09c1e226b570 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:44:59.222270 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-01e307fe-f18a-40b5-837f-09c1e226b570 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] [instance: daedf7bb-47ff-460d-bfb4-ac6166801f10] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:44:59.230463 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-01e307fe-f18a-40b5-837f-09c1e226b570 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:44:59.231044 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-01e307fe-f18a-40b5-837f-09c1e226b570 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:44:59.231859 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-01e307fe-f18a-40b5-837f-09c1e226b570 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:44:59.232302 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-01e307fe-f18a-40b5-837f-09c1e226b570 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:44:59.323567 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-d4e3c0ae-c4b7-4b6d-a1ac-b88a0f63cd1e tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:44:59.324458 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-d4e3c0ae-c4b7-4b6d-a1ac-b88a0f63cd1e tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] [instance: f4a4e6b7-47b1-4de2-8677-4f8e3eb056c2] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:44:59.333450 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-d4e3c0ae-c4b7-4b6d-a1ac-b88a0f63cd1e tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:44:59.334043 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-d4e3c0ae-c4b7-4b6d-a1ac-b88a0f63cd1e tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:44:59.335252 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-d4e3c0ae-c4b7-4b6d-a1ac-b88a0f63cd1e tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:44:59.335984 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-d4e3c0ae-c4b7-4b6d-a1ac-b88a0f63cd1e tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:44:59.517119 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-01e307fe-f18a-40b5-837f-09c1e226b570 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '590e721135c84df5946147ac7e944fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2322cb784615409bb15a6f49522d3b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:44:59.532554 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-01e307fe-f18a-40b5-837f-09c1e226b570 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] 10.222.0.45 "GET /compute/v2.1/servers/daedf7bb-47ff-460d-bfb4-ac6166801f10" status: 200 len: 1672 microversion: 2.1 time: 0.314666 Jan 21 09:44:59.533385 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 591/1188] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:44:59 2022] GET /compute/v2.1/servers/daedf7bb-47ff-460d-bfb4-ac6166801f10 => generated 1672 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:44:59.653556 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-d4e3c0ae-c4b7-4b6d-a1ac-b88a0f63cd1e tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aed8f68a416468cb303ae6c59a2203c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ac0334d1e14c29aa6222d547c64b00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:44:59.673421 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-d4e3c0ae-c4b7-4b6d-a1ac-b88a0f63cd1e tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] 10.222.0.45 "GET /compute/v2.1/servers/f4a4e6b7-47b1-4de2-8677-4f8e3eb056c2" status: 200 len: 1519 microversion: 2.1 time: 0.352916 Jan 21 09:44:59.675103 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 598/1189] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:44:59 2022] GET /compute/v2.1/servers/f4a4e6b7-47b1-4de2-8677-4f8e3eb056c2 => generated 1519 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 09:44:59.842839 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [req-7cdce12b-48d0-4afc-b016-2d17e38bc00b req-5a8541cd-18dc-46a1-ab20-c473bbb970e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "daedf7bb-47ff-460d-bfb4-ac6166801f10", "name": "network-vif-deleted", "tag": "20b2b8f5-45f6-4e4c-a61f-1787996fea63"}]} {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:44:59.845084 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 21 09:44:59.845084 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: warnings.warn(msg) Jan 21 09:44:59.854230 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [req-7cdce12b-48d0-4afc-b016-2d17e38bc00b req-5a8541cd-18dc-46a1-ab20-c473bbb970e8 service nova] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:44:59.854710 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [req-7cdce12b-48d0-4afc-b016-2d17e38bc00b req-5a8541cd-18dc-46a1-ab20-c473bbb970e8 service nova] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:44:59.873398 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.compute.server_external_events [req-7cdce12b-48d0-4afc-b016-2d17e38bc00b req-5a8541cd-18dc-46a1-ab20-c473bbb970e8 service nova] Creating event network-vif-deleted:20b2b8f5-45f6-4e4c-a61f-1787996fea63 for instance daedf7bb-47ff-460d-bfb4-ac6166801f10 on hv-cinder-80403 Jan 21 09:44:59.879131 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [req-7cdce12b-48d0-4afc-b016-2d17e38bc00b req-5a8541cd-18dc-46a1-ab20-c473bbb970e8 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040929 Jan 21 09:44:59.879997 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 592/1190] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Jan 21 09:44:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 09:45:00.554244 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-bbf6cfd0-4323-460e-b2de-27ac49ab1e4f tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:45:00.556555 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-bbf6cfd0-4323-460e-b2de-27ac49ab1e4f tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] [instance: daedf7bb-47ff-460d-bfb4-ac6166801f10] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:45:00.565082 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-bbf6cfd0-4323-460e-b2de-27ac49ab1e4f tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:45:00.566020 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-bbf6cfd0-4323-460e-b2de-27ac49ab1e4f tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:45:00.567090 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-bbf6cfd0-4323-460e-b2de-27ac49ab1e4f tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:45:00.567702 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-bbf6cfd0-4323-460e-b2de-27ac49ab1e4f tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:45:00.615702 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-bbf6cfd0-4323-460e-b2de-27ac49ab1e4f tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:45:00.616406 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-bbf6cfd0-4323-460e-b2de-27ac49ab1e4f tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:45:00.617093 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.objects.instance [None req-bbf6cfd0-4323-460e-b2de-27ac49ab1e4f tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lazy-loading 'fault' on Instance uuid daedf7bb-47ff-460d-bfb4-ac6166801f10 {{(pid=123387) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 21 09:45:00.699846 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-760f6c98-42e4-4345-81f9-cfc3e7dcc504 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:45:00.700462 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-bbf6cfd0-4323-460e-b2de-27ac49ab1e4f tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '590e721135c84df5946147ac7e944fbc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2322cb784615409bb15a6f49522d3b34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:45:00.701915 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-760f6c98-42e4-4345-81f9-cfc3e7dcc504 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] [instance: f4a4e6b7-47b1-4de2-8677-4f8e3eb056c2] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:45:00.712409 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-760f6c98-42e4-4345-81f9-cfc3e7dcc504 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:45:00.712701 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-bbf6cfd0-4323-460e-b2de-27ac49ab1e4f tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] 10.222.0.45 "GET /compute/v2.1/servers/daedf7bb-47ff-460d-bfb4-ac6166801f10" status: 200 len: 1325 microversion: 2.1 time: 0.165441 Jan 21 09:45:00.713697 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 599/1191] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:45:00 2022] GET /compute/v2.1/servers/daedf7bb-47ff-460d-bfb4-ac6166801f10 => generated 1325 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:45:00.713978 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-760f6c98-42e4-4345-81f9-cfc3e7dcc504 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:45:00.716831 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-760f6c98-42e4-4345-81f9-cfc3e7dcc504 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:45:00.718197 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-760f6c98-42e4-4345-81f9-cfc3e7dcc504 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:45:01.021905 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-760f6c98-42e4-4345-81f9-cfc3e7dcc504 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aed8f68a416468cb303ae6c59a2203c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ac0334d1e14c29aa6222d547c64b00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:45:01.031606 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-760f6c98-42e4-4345-81f9-cfc3e7dcc504 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] 10.222.0.45 "GET /compute/v2.1/servers/f4a4e6b7-47b1-4de2-8677-4f8e3eb056c2" status: 200 len: 1575 microversion: 2.1 time: 0.341234 Jan 21 09:45:01.032542 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 593/1192] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:45:00 2022] GET /compute/v2.1/servers/f4a4e6b7-47b1-4de2-8677-4f8e3eb056c2 => generated 1575 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 09:45:01.731003 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-b0a4f864-0bda-4019-831b-d9a8dc1b0fae tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:45:01.731620 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-b0a4f864-0bda-4019-831b-d9a8dc1b0fae tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] [instance: daedf7bb-47ff-460d-bfb4-ac6166801f10] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:45:01.738557 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-b0a4f864-0bda-4019-831b-d9a8dc1b0fae tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:45:01.739008 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-b0a4f864-0bda-4019-831b-d9a8dc1b0fae tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:45:01.740035 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-b0a4f864-0bda-4019-831b-d9a8dc1b0fae tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:45:01.740831 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-b0a4f864-0bda-4019-831b-d9a8dc1b0fae tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:45:01.756485 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.wsgi [None req-b0a4f864-0bda-4019-831b-d9a8dc1b0fae tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] HTTP exception thrown: Instance daedf7bb-47ff-460d-bfb4-ac6166801f10 could not be found. Jan 21 09:45:01.757091 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-b0a4f864-0bda-4019-831b-d9a8dc1b0fae tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Returning 404 to user: Instance daedf7bb-47ff-460d-bfb4-ac6166801f10 could not be found. {{(pid=123387) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 21 09:45:01.757968 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-b0a4f864-0bda-4019-831b-d9a8dc1b0fae tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] 10.222.0.45 "GET /compute/v2.1/servers/daedf7bb-47ff-460d-bfb4-ac6166801f10" status: 404 len: 111 microversion: 2.1 time: 0.030763 Jan 21 09:45:01.758539 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 600/1193] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:45:01 2022] GET /compute/v2.1/servers/daedf7bb-47ff-460d-bfb4-ac6166801f10 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 21 09:45:01.767084 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-f1aba404-6aa4-42cc-944c-cc9a47d10e4a tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Calling method '.version_select at 0x7fb6c8045dc0>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:45:01.876932 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-f1aba404-6aa4-42cc-944c-cc9a47d10e4a tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-532766766" status: 202 len: 0 microversion: 2.1 time: 0.113646 Jan 21 09:45:01.877587 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 594/1194] 10.222.0.45 () {58 vars in 1217 bytes} [Fri Jan 21 09:45:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-532766766 => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 21 09:45:02.049897 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-128b2372-a5c2-46df-90a3-fc3a7cd488bb tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:45:02.050635 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-128b2372-a5c2-46df-90a3-fc3a7cd488bb tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] [instance: f4a4e6b7-47b1-4de2-8677-4f8e3eb056c2] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:45:02.057823 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-128b2372-a5c2-46df-90a3-fc3a7cd488bb tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:45:02.058353 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-128b2372-a5c2-46df-90a3-fc3a7cd488bb tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:45:02.059100 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-128b2372-a5c2-46df-90a3-fc3a7cd488bb tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:45:02.059520 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-128b2372-a5c2-46df-90a3-fc3a7cd488bb tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:45:02.269283 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-128b2372-a5c2-46df-90a3-fc3a7cd488bb tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aed8f68a416468cb303ae6c59a2203c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ac0334d1e14c29aa6222d547c64b00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:45:02.283860 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-128b2372-a5c2-46df-90a3-fc3a7cd488bb tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] 10.222.0.45 "GET /compute/v2.1/servers/f4a4e6b7-47b1-4de2-8677-4f8e3eb056c2" status: 200 len: 1575 microversion: 2.1 time: 0.237243 Jan 21 09:45:02.296734 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 601/1195] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:45:02 2022] GET /compute/v2.1/servers/f4a4e6b7-47b1-4de2-8677-4f8e3eb056c2 => generated 1575 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:45:03.312944 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-bf52b407-d54a-4abe-8942-46dc4bcd5dbe tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:45:03.314170 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-bf52b407-d54a-4abe-8942-46dc4bcd5dbe tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] [instance: f4a4e6b7-47b1-4de2-8677-4f8e3eb056c2] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:45:03.327614 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-bf52b407-d54a-4abe-8942-46dc4bcd5dbe tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:45:03.328447 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-bf52b407-d54a-4abe-8942-46dc4bcd5dbe tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:45:03.329958 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-bf52b407-d54a-4abe-8942-46dc4bcd5dbe tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:45:03.330725 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-bf52b407-d54a-4abe-8942-46dc4bcd5dbe tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:45:03.513110 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-bf52b407-d54a-4abe-8942-46dc4bcd5dbe tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aed8f68a416468cb303ae6c59a2203c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ac0334d1e14c29aa6222d547c64b00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:45:03.523092 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-bf52b407-d54a-4abe-8942-46dc4bcd5dbe tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] 10.222.0.45 "GET /compute/v2.1/servers/f4a4e6b7-47b1-4de2-8677-4f8e3eb056c2" status: 200 len: 1575 microversion: 2.1 time: 0.216705 Jan 21 09:45:03.523777 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 595/1196] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:45:03 2022] GET /compute/v2.1/servers/f4a4e6b7-47b1-4de2-8677-4f8e3eb056c2 => generated 1575 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 09:45:04.544010 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-ac517238-9f60-4f22-ac47-5117fa27100c tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:45:04.544753 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-ac517238-9f60-4f22-ac47-5117fa27100c tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] [instance: f4a4e6b7-47b1-4de2-8677-4f8e3eb056c2] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:45:04.551465 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-ac517238-9f60-4f22-ac47-5117fa27100c tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:45:04.551912 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-ac517238-9f60-4f22-ac47-5117fa27100c tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:45:04.561841 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-ac517238-9f60-4f22-ac47-5117fa27100c tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:45:04.561841 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-ac517238-9f60-4f22-ac47-5117fa27100c tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:45:04.730030 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-ac517238-9f60-4f22-ac47-5117fa27100c tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aed8f68a416468cb303ae6c59a2203c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ac0334d1e14c29aa6222d547c64b00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:45:04.738419 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-ac517238-9f60-4f22-ac47-5117fa27100c tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] 10.222.0.45 "GET /compute/v2.1/servers/f4a4e6b7-47b1-4de2-8677-4f8e3eb056c2" status: 200 len: 1575 microversion: 2.1 time: 0.199548 Jan 21 09:45:04.739012 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 602/1197] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:45:04 2022] GET /compute/v2.1/servers/f4a4e6b7-47b1-4de2-8677-4f8e3eb056c2 => generated 1575 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 09:45:05.592280 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-6104d6b3-7931-4372-a353-f0f2f82990ba tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:45:05.597674 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-6104d6b3-7931-4372-a353-f0f2f82990ba tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] [instance: daedf7bb-47ff-460d-bfb4-ac6166801f10] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:45:05.600861 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-6104d6b3-7931-4372-a353-f0f2f82990ba tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:45:05.601379 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-6104d6b3-7931-4372-a353-f0f2f82990ba tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:45:05.602208 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-6104d6b3-7931-4372-a353-f0f2f82990ba tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:45:05.602646 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-6104d6b3-7931-4372-a353-f0f2f82990ba tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:45:05.618482 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.wsgi [None req-6104d6b3-7931-4372-a353-f0f2f82990ba tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] HTTP exception thrown: Instance daedf7bb-47ff-460d-bfb4-ac6166801f10 could not be found. Jan 21 09:45:05.619145 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-6104d6b3-7931-4372-a353-f0f2f82990ba tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Returning 404 to user: Instance daedf7bb-47ff-460d-bfb4-ac6166801f10 could not be found. {{(pid=123386) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 21 09:45:05.619944 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-6104d6b3-7931-4372-a353-f0f2f82990ba tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] 10.222.0.45 "DELETE /compute/v2.1/servers/daedf7bb-47ff-460d-bfb4-ac6166801f10" status: 404 len: 111 microversion: 2.1 time: 0.031650 Jan 21 09:45:05.620621 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 596/1198] 10.222.0.45 () {58 vars in 1238 bytes} [Fri Jan 21 09:45:05 2022] DELETE /compute/v2.1/servers/daedf7bb-47ff-460d-bfb4-ac6166801f10 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 21 09:45:05.628629 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-3ecb42c6-c461-422d-bd77-d2c7a7c903d4 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:45:05.629475 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-3ecb42c6-c461-422d-bd77-d2c7a7c903d4 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] [instance: daedf7bb-47ff-460d-bfb4-ac6166801f10] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:45:05.636937 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-3ecb42c6-c461-422d-bd77-d2c7a7c903d4 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:45:05.637415 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-3ecb42c6-c461-422d-bd77-d2c7a7c903d4 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:45:05.638435 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-3ecb42c6-c461-422d-bd77-d2c7a7c903d4 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:45:05.639010 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-3ecb42c6-c461-422d-bd77-d2c7a7c903d4 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:45:05.656404 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.wsgi [None req-3ecb42c6-c461-422d-bd77-d2c7a7c903d4 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] HTTP exception thrown: Instance daedf7bb-47ff-460d-bfb4-ac6166801f10 could not be found. Jan 21 09:45:05.656988 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-3ecb42c6-c461-422d-bd77-d2c7a7c903d4 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Returning 404 to user: Instance daedf7bb-47ff-460d-bfb4-ac6166801f10 could not be found. {{(pid=123387) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 21 09:45:05.657906 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-3ecb42c6-c461-422d-bd77-d2c7a7c903d4 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] 10.222.0.45 "GET /compute/v2.1/servers/daedf7bb-47ff-460d-bfb4-ac6166801f10" status: 404 len: 111 microversion: 2.1 time: 0.033168 Jan 21 09:45:05.658476 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 603/1199] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:45:05 2022] GET /compute/v2.1/servers/daedf7bb-47ff-460d-bfb4-ac6166801f10 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 21 09:45:05.756130 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-8b44b9d3-999d-4c34-aaf7-c32c8f4128b2 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:45:05.756752 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-8b44b9d3-999d-4c34-aaf7-c32c8f4128b2 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] [instance: f4a4e6b7-47b1-4de2-8677-4f8e3eb056c2] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:45:05.762793 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-8b44b9d3-999d-4c34-aaf7-c32c8f4128b2 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:45:05.763236 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-8b44b9d3-999d-4c34-aaf7-c32c8f4128b2 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:45:05.764019 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-8b44b9d3-999d-4c34-aaf7-c32c8f4128b2 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:45:05.764559 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-8b44b9d3-999d-4c34-aaf7-c32c8f4128b2 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:45:05.932125 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-8b44b9d3-999d-4c34-aaf7-c32c8f4128b2 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aed8f68a416468cb303ae6c59a2203c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ac0334d1e14c29aa6222d547c64b00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:45:05.947121 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-8b44b9d3-999d-4c34-aaf7-c32c8f4128b2 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] 10.222.0.45 "GET /compute/v2.1/servers/f4a4e6b7-47b1-4de2-8677-4f8e3eb056c2" status: 200 len: 1575 microversion: 2.1 time: 0.194788 Jan 21 09:45:05.948347 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 597/1200] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:45:05 2022] GET /compute/v2.1/servers/f4a4e6b7-47b1-4de2-8677-4f8e3eb056c2 => generated 1575 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:45:06.964916 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-6e7c0f9c-4cd6-4ade-b781-54511d631373 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:45:06.965556 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-6e7c0f9c-4cd6-4ade-b781-54511d631373 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] [instance: f4a4e6b7-47b1-4de2-8677-4f8e3eb056c2] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:45:06.972527 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-6e7c0f9c-4cd6-4ade-b781-54511d631373 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:45:06.973005 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-6e7c0f9c-4cd6-4ade-b781-54511d631373 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:45:06.974668 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-6e7c0f9c-4cd6-4ade-b781-54511d631373 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:45:06.975008 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-6e7c0f9c-4cd6-4ade-b781-54511d631373 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:45:06.997653 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-7790ab16-3f06-49bb-9dd9-5eea8f20855c tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:45:06.998290 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-7790ab16-3f06-49bb-9dd9-5eea8f20855c tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] [instance: 9c18953a-7af3-4d71-97ad-05eda7e34a73] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:45:07.005676 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-7790ab16-3f06-49bb-9dd9-5eea8f20855c tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:45:07.006206 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-7790ab16-3f06-49bb-9dd9-5eea8f20855c tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:45:07.007037 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-7790ab16-3f06-49bb-9dd9-5eea8f20855c tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:45:07.007970 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-7790ab16-3f06-49bb-9dd9-5eea8f20855c tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:45:07.023526 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.wsgi [None req-7790ab16-3f06-49bb-9dd9-5eea8f20855c tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] HTTP exception thrown: Instance 9c18953a-7af3-4d71-97ad-05eda7e34a73 could not be found. Jan 21 09:45:07.024447 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-7790ab16-3f06-49bb-9dd9-5eea8f20855c tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Returning 404 to user: Instance 9c18953a-7af3-4d71-97ad-05eda7e34a73 could not be found. {{(pid=123386) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 21 09:45:07.024950 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-7790ab16-3f06-49bb-9dd9-5eea8f20855c tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] 10.222.0.45 "DELETE /compute/v2.1/servers/9c18953a-7af3-4d71-97ad-05eda7e34a73" status: 404 len: 111 microversion: 2.1 time: 0.031065 Jan 21 09:45:07.025613 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 598/1201] 10.222.0.45 () {58 vars in 1238 bytes} [Fri Jan 21 09:45:06 2022] DELETE /compute/v2.1/servers/9c18953a-7af3-4d71-97ad-05eda7e34a73 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 21 09:45:07.033648 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-e6ab2610-d4e5-4d66-ac25-aa5c420a4313 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:45:07.034264 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-e6ab2610-d4e5-4d66-ac25-aa5c420a4313 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] [instance: 9c18953a-7af3-4d71-97ad-05eda7e34a73] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:45:07.041063 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-e6ab2610-d4e5-4d66-ac25-aa5c420a4313 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:45:07.041697 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-e6ab2610-d4e5-4d66-ac25-aa5c420a4313 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:45:07.042513 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-e6ab2610-d4e5-4d66-ac25-aa5c420a4313 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:45:07.042943 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-e6ab2610-d4e5-4d66-ac25-aa5c420a4313 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:45:07.059720 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.wsgi [None req-e6ab2610-d4e5-4d66-ac25-aa5c420a4313 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] HTTP exception thrown: Instance 9c18953a-7af3-4d71-97ad-05eda7e34a73 could not be found. Jan 21 09:45:07.060446 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-e6ab2610-d4e5-4d66-ac25-aa5c420a4313 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] Returning 404 to user: Instance 9c18953a-7af3-4d71-97ad-05eda7e34a73 could not be found. {{(pid=123386) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 21 09:45:07.061396 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-e6ab2610-d4e5-4d66-ac25-aa5c420a4313 tempest-AttachVolumeTestJSON-524637070 tempest-AttachVolumeTestJSON-524637070-project] 10.222.0.45 "GET /compute/v2.1/servers/9c18953a-7af3-4d71-97ad-05eda7e34a73" status: 404 len: 111 microversion: 2.1 time: 0.031375 Jan 21 09:45:07.064526 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 599/1202] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:45:07 2022] GET /compute/v2.1/servers/9c18953a-7af3-4d71-97ad-05eda7e34a73 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 21 09:45:07.132957 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-6e7c0f9c-4cd6-4ade-b781-54511d631373 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aed8f68a416468cb303ae6c59a2203c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ac0334d1e14c29aa6222d547c64b00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:45:07.142160 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-6e7c0f9c-4cd6-4ade-b781-54511d631373 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] 10.222.0.45 "GET /compute/v2.1/servers/f4a4e6b7-47b1-4de2-8677-4f8e3eb056c2" status: 200 len: 1575 microversion: 2.1 time: 0.180463 Jan 21 09:45:07.143311 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 604/1203] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:45:06 2022] GET /compute/v2.1/servers/f4a4e6b7-47b1-4de2-8677-4f8e3eb056c2 => generated 1575 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:45:08.170204 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-3a3bb49c-e376-4eb7-b176-30c7b53f951d tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:45:08.170878 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-3a3bb49c-e376-4eb7-b176-30c7b53f951d tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] [instance: f4a4e6b7-47b1-4de2-8677-4f8e3eb056c2] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:45:08.178538 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-3a3bb49c-e376-4eb7-b176-30c7b53f951d tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:45:08.179012 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-3a3bb49c-e376-4eb7-b176-30c7b53f951d tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:45:08.179819 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-3a3bb49c-e376-4eb7-b176-30c7b53f951d tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:45:08.180259 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-3a3bb49c-e376-4eb7-b176-30c7b53f951d tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:45:08.340733 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-3a3bb49c-e376-4eb7-b176-30c7b53f951d tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aed8f68a416468cb303ae6c59a2203c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ac0334d1e14c29aa6222d547c64b00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:45:08.350409 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-3a3bb49c-e376-4eb7-b176-30c7b53f951d tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] 10.222.0.45 "GET /compute/v2.1/servers/f4a4e6b7-47b1-4de2-8677-4f8e3eb056c2" status: 200 len: 1575 microversion: 2.1 time: 0.183471 Jan 21 09:45:08.365993 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 600/1204] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:45:08 2022] GET /compute/v2.1/servers/f4a4e6b7-47b1-4de2-8677-4f8e3eb056c2 => generated 1575 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:45:09.371671 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-30c5d537-117c-4750-94c4-61405d85c23f tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:45:09.373540 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-30c5d537-117c-4750-94c4-61405d85c23f tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] [instance: f4a4e6b7-47b1-4de2-8677-4f8e3eb056c2] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:45:09.384432 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-30c5d537-117c-4750-94c4-61405d85c23f tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:45:09.385798 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-30c5d537-117c-4750-94c4-61405d85c23f tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:45:09.386949 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-30c5d537-117c-4750-94c4-61405d85c23f tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:45:09.403212 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-30c5d537-117c-4750-94c4-61405d85c23f tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:45:10.011348 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-30c5d537-117c-4750-94c4-61405d85c23f tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aed8f68a416468cb303ae6c59a2203c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ac0334d1e14c29aa6222d547c64b00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:45:10.019915 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-30c5d537-117c-4750-94c4-61405d85c23f tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] 10.222.0.45 "GET /compute/v2.1/servers/f4a4e6b7-47b1-4de2-8677-4f8e3eb056c2" status: 200 len: 1575 microversion: 2.1 time: 0.656095 Jan 21 09:45:10.021800 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 605/1205] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:45:09 2022] GET /compute/v2.1/servers/f4a4e6b7-47b1-4de2-8677-4f8e3eb056c2 => generated 1575 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:45:11.042322 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-f5de8407-63b8-4287-9ffc-ae6073e8e592 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:45:11.043195 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-f5de8407-63b8-4287-9ffc-ae6073e8e592 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] [instance: f4a4e6b7-47b1-4de2-8677-4f8e3eb056c2] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:45:11.051583 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-f5de8407-63b8-4287-9ffc-ae6073e8e592 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:45:11.052701 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-f5de8407-63b8-4287-9ffc-ae6073e8e592 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:45:11.053859 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-f5de8407-63b8-4287-9ffc-ae6073e8e592 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:45:11.054363 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-f5de8407-63b8-4287-9ffc-ae6073e8e592 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:45:11.066767 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [req-187178a3-fe0c-4733-a100-e15982602cf6 req-fb9e1c4a-27ae-4842-90dd-d128c54aecb4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4a4e6b7-47b1-4de2-8677-4f8e3eb056c2", "name": "network-vif-plugged", "status": "completed", "tag": "0e43678c-54de-414e-81b5-5773897a97f4"}]} {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:45:11.072836 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 21 09:45:11.072836 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: warnings.warn(msg) Jan 21 09:45:11.092802 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [req-187178a3-fe0c-4733-a100-e15982602cf6 req-fb9e1c4a-27ae-4842-90dd-d128c54aecb4 service nova] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:45:11.092802 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [req-187178a3-fe0c-4733-a100-e15982602cf6 req-fb9e1c4a-27ae-4842-90dd-d128c54aecb4 service nova] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:45:11.106901 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.compute.server_external_events [req-187178a3-fe0c-4733-a100-e15982602cf6 req-fb9e1c4a-27ae-4842-90dd-d128c54aecb4 service nova] Creating event network-vif-plugged:0e43678c-54de-414e-81b5-5773897a97f4 for instance f4a4e6b7-47b1-4de2-8677-4f8e3eb056c2 on hv-cinder-80403 Jan 21 09:45:11.113922 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [req-187178a3-fe0c-4733-a100-e15982602cf6 req-fb9e1c4a-27ae-4842-90dd-d128c54aecb4 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051229 Jan 21 09:45:11.114488 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 606/1206] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Jan 21 09:45:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 09:45:11.285235 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-f5de8407-63b8-4287-9ffc-ae6073e8e592 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aed8f68a416468cb303ae6c59a2203c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ac0334d1e14c29aa6222d547c64b00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:45:11.294658 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-f5de8407-63b8-4287-9ffc-ae6073e8e592 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] 10.222.0.45 "GET /compute/v2.1/servers/f4a4e6b7-47b1-4de2-8677-4f8e3eb056c2" status: 200 len: 1575 microversion: 2.1 time: 0.258125 Jan 21 09:45:11.295233 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 601/1207] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:45:11 2022] GET /compute/v2.1/servers/f4a4e6b7-47b1-4de2-8677-4f8e3eb056c2 => generated 1575 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:45:12.324863 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-a5e5711e-4e86-49cb-abb7-0fc2e893820e tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:45:12.324863 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-a5e5711e-4e86-49cb-abb7-0fc2e893820e tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] [instance: f4a4e6b7-47b1-4de2-8677-4f8e3eb056c2] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:45:12.349836 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-a5e5711e-4e86-49cb-abb7-0fc2e893820e tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:45:12.350578 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-a5e5711e-4e86-49cb-abb7-0fc2e893820e tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:45:12.351563 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-a5e5711e-4e86-49cb-abb7-0fc2e893820e tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:45:12.352007 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-a5e5711e-4e86-49cb-abb7-0fc2e893820e tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:45:12.609179 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-a5e5711e-4e86-49cb-abb7-0fc2e893820e tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aed8f68a416468cb303ae6c59a2203c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ac0334d1e14c29aa6222d547c64b00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:45:12.621940 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-a5e5711e-4e86-49cb-abb7-0fc2e893820e tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] 10.222.0.45 "GET /compute/v2.1/servers/f4a4e6b7-47b1-4de2-8677-4f8e3eb056c2" status: 200 len: 1575 microversion: 2.1 time: 0.311217 Jan 21 09:45:12.623294 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 607/1208] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:45:12 2022] GET /compute/v2.1/servers/f4a4e6b7-47b1-4de2-8677-4f8e3eb056c2 => generated 1575 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:45:13.652555 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-3675d083-cbf8-4b49-b8d5-c45f2e44a105 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:45:13.653216 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-3675d083-cbf8-4b49-b8d5-c45f2e44a105 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] [instance: f4a4e6b7-47b1-4de2-8677-4f8e3eb056c2] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:45:13.660327 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-3675d083-cbf8-4b49-b8d5-c45f2e44a105 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:45:13.660770 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-3675d083-cbf8-4b49-b8d5-c45f2e44a105 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:45:13.661774 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-3675d083-cbf8-4b49-b8d5-c45f2e44a105 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:45:13.662217 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-3675d083-cbf8-4b49-b8d5-c45f2e44a105 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:45:13.825882 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-3675d083-cbf8-4b49-b8d5-c45f2e44a105 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aed8f68a416468cb303ae6c59a2203c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ac0334d1e14c29aa6222d547c64b00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:45:13.834386 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-3675d083-cbf8-4b49-b8d5-c45f2e44a105 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] 10.222.0.45 "GET /compute/v2.1/servers/f4a4e6b7-47b1-4de2-8677-4f8e3eb056c2" status: 200 len: 1562 microversion: 2.1 time: 0.190170 Jan 21 09:45:13.834961 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 602/1209] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:45:13 2022] GET /compute/v2.1/servers/f4a4e6b7-47b1-4de2-8677-4f8e3eb056c2 => generated 1562 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 09:46:24.152113 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-1ee51baf-a8a0-4928-bebb-a0ce5ce8030f tempest-VolumesNegativeTest-107566329 tempest-VolumesNegativeTest-107566329-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-533429692", "imageRef": "813e53ee-82e7-4a13-9f63-a8be7b1089f1", "flavorRef": "452"}} {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:46:24.385264 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.network.neutron [None req-1ee51baf-a8a0-4928-bebb-a0ce5ce8030f tempest-VolumesNegativeTest-107566329 tempest-VolumesNegativeTest-107566329-project] validate_networks() for None {{(pid=123387) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Jan 21 09:46:24.680916 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.virt.hardware [None req-1ee51baf-a8a0-4928-bebb-a0ce5ce8030f tempest-VolumesNegativeTest-107566329 tempest-VolumesNegativeTest-107566329-project] Flavor limits 0:0:0 {{(pid=123387) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jan 21 09:46:24.681373 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.virt.hardware [None req-1ee51baf-a8a0-4928-bebb-a0ce5ce8030f tempest-VolumesNegativeTest-107566329 tempest-VolumesNegativeTest-107566329-project] Image limits 0:0:0 {{(pid=123387) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jan 21 09:46:24.681858 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.virt.hardware [None req-1ee51baf-a8a0-4928-bebb-a0ce5ce8030f tempest-VolumesNegativeTest-107566329 tempest-VolumesNegativeTest-107566329-project] Flavor pref 0:0:0 {{(pid=123387) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jan 21 09:46:24.682270 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.virt.hardware [None req-1ee51baf-a8a0-4928-bebb-a0ce5ce8030f tempest-VolumesNegativeTest-107566329 tempest-VolumesNegativeTest-107566329-project] Image pref 0:0:0 {{(pid=123387) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jan 21 09:46:24.682673 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.virt.hardware [None req-1ee51baf-a8a0-4928-bebb-a0ce5ce8030f tempest-VolumesNegativeTest-107566329 tempest-VolumesNegativeTest-107566329-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123387) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jan 21 09:46:24.693294 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-1ee51baf-a8a0-4928-bebb-a0ce5ce8030f tempest-VolumesNegativeTest-107566329 tempest-VolumesNegativeTest-107566329-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:46:24.693757 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-1ee51baf-a8a0-4928-bebb-a0ce5ce8030f tempest-VolumesNegativeTest-107566329 tempest-VolumesNegativeTest-107566329-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:46:24.694688 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-1ee51baf-a8a0-4928-bebb-a0ce5ce8030f tempest-VolumesNegativeTest-107566329 tempest-VolumesNegativeTest-107566329-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:46:24.695126 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-1ee51baf-a8a0-4928-bebb-a0ce5ce8030f tempest-VolumesNegativeTest-107566329 tempest-VolumesNegativeTest-107566329-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:46:24.712514 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.quota [None req-1ee51baf-a8a0-4928-bebb-a0ce5ce8030f tempest-VolumesNegativeTest-107566329 tempest-VolumesNegativeTest-107566329-project] Getting quotas for project 25379f3eeace4e16bd9175662919b699. Resources: {'cores', 'instances', 'ram'} {{(pid=123387) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jan 21 09:46:24.716490 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.quota [None req-1ee51baf-a8a0-4928-bebb-a0ce5ce8030f tempest-VolumesNegativeTest-107566329 tempest-VolumesNegativeTest-107566329-project] Getting quotas for user bf22b24d10674077bef9590d74eb39e9 and project 25379f3eeace4e16bd9175662919b699. Resources: {'cores', 'instances', 'ram'} {{(pid=123387) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jan 21 09:46:24.727910 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-1ee51baf-a8a0-4928-bebb-a0ce5ce8030f tempest-VolumesNegativeTest-107566329 tempest-VolumesNegativeTest-107566329-project] Going to run 1 instances... {{(pid=123387) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Jan 21 09:46:24.730290 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-1ee51baf-a8a0-4928-bebb-a0ce5ce8030f tempest-VolumesNegativeTest-107566329 tempest-VolumesNegativeTest-107566329-project] [instance: 1b2c2e3a-393a-4352-afc8-73190dab4a8c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='813e53ee-82e7-4a13-9f63-a8be7b1089f1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123387) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Jan 21 09:46:24.869975 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-1ee51baf-a8a0-4928-bebb-a0ce5ce8030f tempest-VolumesNegativeTest-107566329 tempest-VolumesNegativeTest-107566329-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.723091 Jan 21 09:46:24.870644 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 608/1210] 10.222.0.45 () {60 vars in 1146 bytes} [Fri Jan 21 09:46:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 725 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jan 21 09:46:24.882625 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-ccf8d037-a992-46ab-b132-81b9cd958e5c tempest-VolumesNegativeTest-107566329 tempest-VolumesNegativeTest-107566329-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:46:24.883208 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-ccf8d037-a992-46ab-b132-81b9cd958e5c tempest-VolumesNegativeTest-107566329 tempest-VolumesNegativeTest-107566329-project] [instance: 1b2c2e3a-393a-4352-afc8-73190dab4a8c] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:46:25.074995 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-ccf8d037-a992-46ab-b132-81b9cd958e5c tempest-VolumesNegativeTest-107566329 tempest-VolumesNegativeTest-107566329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf22b24d10674077bef9590d74eb39e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25379f3eeace4e16bd9175662919b699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:46:25.081707 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-ccf8d037-a992-46ab-b132-81b9cd958e5c tempest-VolumesNegativeTest-107566329 tempest-VolumesNegativeTest-107566329-project] 10.222.0.45 "GET /compute/v2.1/servers/1b2c2e3a-393a-4352-afc8-73190dab4a8c" status: 200 len: 1214 microversion: 2.1 time: 0.205035 Jan 21 09:46:25.090381 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 603/1211] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:46:24 2022] GET /compute/v2.1/servers/1b2c2e3a-393a-4352-afc8-73190dab4a8c => generated 1214 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 09:46:26.099030 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-886d2fd5-9cce-4f48-a7a9-8744bb765414 tempest-VolumesNegativeTest-107566329 tempest-VolumesNegativeTest-107566329-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:46:26.099635 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-886d2fd5-9cce-4f48-a7a9-8744bb765414 tempest-VolumesNegativeTest-107566329 tempest-VolumesNegativeTest-107566329-project] [instance: 1b2c2e3a-393a-4352-afc8-73190dab4a8c] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:46:26.107350 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-886d2fd5-9cce-4f48-a7a9-8744bb765414 tempest-VolumesNegativeTest-107566329 tempest-VolumesNegativeTest-107566329-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:46:26.107789 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-886d2fd5-9cce-4f48-a7a9-8744bb765414 tempest-VolumesNegativeTest-107566329 tempest-VolumesNegativeTest-107566329-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:46:26.108581 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-886d2fd5-9cce-4f48-a7a9-8744bb765414 tempest-VolumesNegativeTest-107566329 tempest-VolumesNegativeTest-107566329-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:46:26.109016 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-886d2fd5-9cce-4f48-a7a9-8744bb765414 tempest-VolumesNegativeTest-107566329 tempest-VolumesNegativeTest-107566329-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:46:26.173853 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-886d2fd5-9cce-4f48-a7a9-8744bb765414 tempest-VolumesNegativeTest-107566329 tempest-VolumesNegativeTest-107566329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf22b24d10674077bef9590d74eb39e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25379f3eeace4e16bd9175662919b699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:46:26.181632 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-886d2fd5-9cce-4f48-a7a9-8744bb765414 tempest-VolumesNegativeTest-107566329 tempest-VolumesNegativeTest-107566329-project] 10.222.0.45 "GET /compute/v2.1/servers/1b2c2e3a-393a-4352-afc8-73190dab4a8c" status: 200 len: 1218 microversion: 2.1 time: 0.086377 Jan 21 09:46:26.182814 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 609/1212] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:46:26 2022] GET /compute/v2.1/servers/1b2c2e3a-393a-4352-afc8-73190dab4a8c => generated 1218 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:46:27.201260 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-163a227b-1677-48ca-94bb-5931629bc521 tempest-VolumesNegativeTest-107566329 tempest-VolumesNegativeTest-107566329-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:46:27.201900 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-163a227b-1677-48ca-94bb-5931629bc521 tempest-VolumesNegativeTest-107566329 tempest-VolumesNegativeTest-107566329-project] [instance: 1b2c2e3a-393a-4352-afc8-73190dab4a8c] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:46:27.210255 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-163a227b-1677-48ca-94bb-5931629bc521 tempest-VolumesNegativeTest-107566329 tempest-VolumesNegativeTest-107566329-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:46:27.213125 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-163a227b-1677-48ca-94bb-5931629bc521 tempest-VolumesNegativeTest-107566329 tempest-VolumesNegativeTest-107566329-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:46:27.214018 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-163a227b-1677-48ca-94bb-5931629bc521 tempest-VolumesNegativeTest-107566329 tempest-VolumesNegativeTest-107566329-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:46:27.217855 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-163a227b-1677-48ca-94bb-5931629bc521 tempest-VolumesNegativeTest-107566329 tempest-VolumesNegativeTest-107566329-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:46:27.298374 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-163a227b-1677-48ca-94bb-5931629bc521 tempest-VolumesNegativeTest-107566329 tempest-VolumesNegativeTest-107566329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf22b24d10674077bef9590d74eb39e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25379f3eeace4e16bd9175662919b699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:46:27.307917 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-163a227b-1677-48ca-94bb-5931629bc521 tempest-VolumesNegativeTest-107566329 tempest-VolumesNegativeTest-107566329-project] 10.222.0.45 "GET /compute/v2.1/servers/1b2c2e3a-393a-4352-afc8-73190dab4a8c" status: 200 len: 1272 microversion: 2.1 time: 0.111707 Jan 21 09:46:27.308627 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 604/1213] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:46:27 2022] GET /compute/v2.1/servers/1b2c2e3a-393a-4352-afc8-73190dab4a8c => generated 1272 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:46:28.333576 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-f7195a42-13c8-4cbb-8c97-f182e86ee93a tempest-VolumesNegativeTest-107566329 tempest-VolumesNegativeTest-107566329-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:46:28.334382 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-f7195a42-13c8-4cbb-8c97-f182e86ee93a tempest-VolumesNegativeTest-107566329 tempest-VolumesNegativeTest-107566329-project] [instance: 1b2c2e3a-393a-4352-afc8-73190dab4a8c] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:46:28.340941 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-f7195a42-13c8-4cbb-8c97-f182e86ee93a tempest-VolumesNegativeTest-107566329 tempest-VolumesNegativeTest-107566329-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:46:28.341597 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-f7195a42-13c8-4cbb-8c97-f182e86ee93a tempest-VolumesNegativeTest-107566329 tempest-VolumesNegativeTest-107566329-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:46:28.342370 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-f7195a42-13c8-4cbb-8c97-f182e86ee93a tempest-VolumesNegativeTest-107566329 tempest-VolumesNegativeTest-107566329-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:46:28.343055 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-f7195a42-13c8-4cbb-8c97-f182e86ee93a tempest-VolumesNegativeTest-107566329 tempest-VolumesNegativeTest-107566329-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:46:28.566688 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-f7195a42-13c8-4cbb-8c97-f182e86ee93a tempest-VolumesNegativeTest-107566329 tempest-VolumesNegativeTest-107566329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf22b24d10674077bef9590d74eb39e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25379f3eeace4e16bd9175662919b699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:46:28.574199 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-f7195a42-13c8-4cbb-8c97-f182e86ee93a tempest-VolumesNegativeTest-107566329 tempest-VolumesNegativeTest-107566329-project] 10.222.0.45 "GET /compute/v2.1/servers/1b2c2e3a-393a-4352-afc8-73190dab4a8c" status: 200 len: 1314 microversion: 2.1 time: 0.245865 Jan 21 09:46:28.579066 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 610/1214] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:46:28 2022] GET /compute/v2.1/servers/1b2c2e3a-393a-4352-afc8-73190dab4a8c => generated 1314 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:46:29.088483 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [req-55793037-7958-4e38-8763-db6eadd8980e req-54425887-a6f0-411b-a843-dde0b290c3af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1b2c2e3a-393a-4352-afc8-73190dab4a8c", "tag": "c3b0aa84-3336-4a8d-b90c-878574a4383e"}]} {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:46:29.090216 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 21 09:46:29.090216 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: warnings.warn(msg) Jan 21 09:46:29.098075 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [req-55793037-7958-4e38-8763-db6eadd8980e req-54425887-a6f0-411b-a843-dde0b290c3af service nova] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:46:29.098517 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [req-55793037-7958-4e38-8763-db6eadd8980e req-54425887-a6f0-411b-a843-dde0b290c3af service nova] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:46:29.114532 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.compute.server_external_events [req-55793037-7958-4e38-8763-db6eadd8980e req-54425887-a6f0-411b-a843-dde0b290c3af service nova] Creating event network-changed:c3b0aa84-3336-4a8d-b90c-878574a4383e for instance 1b2c2e3a-393a-4352-afc8-73190dab4a8c on hv-cinder-80403 Jan 21 09:46:29.120040 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [req-55793037-7958-4e38-8763-db6eadd8980e req-54425887-a6f0-411b-a843-dde0b290c3af service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.136872 Jan 21 09:46:29.120951 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 605/1215] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Jan 21 09:46:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 09:46:29.591486 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-2d7f510f-097e-48ba-8aa5-8c19e3870310 tempest-VolumesNegativeTest-107566329 tempest-VolumesNegativeTest-107566329-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:46:29.592144 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-2d7f510f-097e-48ba-8aa5-8c19e3870310 tempest-VolumesNegativeTest-107566329 tempest-VolumesNegativeTest-107566329-project] [instance: 1b2c2e3a-393a-4352-afc8-73190dab4a8c] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:46:29.598673 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-2d7f510f-097e-48ba-8aa5-8c19e3870310 tempest-VolumesNegativeTest-107566329 tempest-VolumesNegativeTest-107566329-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:46:29.599129 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-2d7f510f-097e-48ba-8aa5-8c19e3870310 tempest-VolumesNegativeTest-107566329 tempest-VolumesNegativeTest-107566329-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:46:29.602816 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-2d7f510f-097e-48ba-8aa5-8c19e3870310 tempest-VolumesNegativeTest-107566329 tempest-VolumesNegativeTest-107566329-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:46:29.602816 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-2d7f510f-097e-48ba-8aa5-8c19e3870310 tempest-VolumesNegativeTest-107566329 tempest-VolumesNegativeTest-107566329-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:46:29.823125 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-2d7f510f-097e-48ba-8aa5-8c19e3870310 tempest-VolumesNegativeTest-107566329 tempest-VolumesNegativeTest-107566329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf22b24d10674077bef9590d74eb39e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25379f3eeace4e16bd9175662919b699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:46:29.831978 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-2d7f510f-097e-48ba-8aa5-8c19e3870310 tempest-VolumesNegativeTest-107566329 tempest-VolumesNegativeTest-107566329-project] 10.222.0.45 "GET /compute/v2.1/servers/1b2c2e3a-393a-4352-afc8-73190dab4a8c" status: 200 len: 1314 microversion: 2.1 time: 0.244113 Jan 21 09:46:29.832575 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 611/1216] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:46:29 2022] GET /compute/v2.1/servers/1b2c2e3a-393a-4352-afc8-73190dab4a8c => generated 1314 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:46:30.702286 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-8f6ef7fc-5729-4081-8275-20907ce96b19 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:46:30.703045 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-8f6ef7fc-5729-4081-8275-20907ce96b19 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] [instance: f4a4e6b7-47b1-4de2-8677-4f8e3eb056c2] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:46:30.711042 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-8f6ef7fc-5729-4081-8275-20907ce96b19 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:46:30.711565 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-8f6ef7fc-5729-4081-8275-20907ce96b19 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:46:30.712717 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-8f6ef7fc-5729-4081-8275-20907ce96b19 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:46:30.713265 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-8f6ef7fc-5729-4081-8275-20907ce96b19 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:46:30.740925 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-8f6ef7fc-5729-4081-8275-20907ce96b19 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] [instance: f4a4e6b7-47b1-4de2-8677-4f8e3eb056c2] Going to try to terminate instance {{(pid=123386) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 21 09:46:30.780371 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [req-aba73aaa-5108-45b5-a852-fcb8bc740a6b req-4f6e2fe2-f1f9-46b6-a69d-be60712fea3e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f4a4e6b7-47b1-4de2-8677-4f8e3eb056c2", "tag": "0e43678c-54de-414e-81b5-5773897a97f4"}]} {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:46:30.783080 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 21 09:46:30.783080 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: warnings.warn(msg) Jan 21 09:46:30.790600 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [req-aba73aaa-5108-45b5-a852-fcb8bc740a6b req-4f6e2fe2-f1f9-46b6-a69d-be60712fea3e service nova] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:46:30.791259 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [req-aba73aaa-5108-45b5-a852-fcb8bc740a6b req-4f6e2fe2-f1f9-46b6-a69d-be60712fea3e service nova] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:46:30.803192 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.compute.server_external_events [req-aba73aaa-5108-45b5-a852-fcb8bc740a6b req-4f6e2fe2-f1f9-46b6-a69d-be60712fea3e service nova] Creating event network-changed:0e43678c-54de-414e-81b5-5773897a97f4 for instance f4a4e6b7-47b1-4de2-8677-4f8e3eb056c2 on hv-cinder-80403 Jan 21 09:46:30.808528 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [req-aba73aaa-5108-45b5-a852-fcb8bc740a6b req-4f6e2fe2-f1f9-46b6-a69d-be60712fea3e service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108754 Jan 21 09:46:30.809139 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 612/1217] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Jan 21 09:46:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 21 09:46:30.852147 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-ea4a41a2-7371-46bd-af0f-4c64933b8763 tempest-VolumesNegativeTest-107566329 tempest-VolumesNegativeTest-107566329-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:46:30.853179 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-ea4a41a2-7371-46bd-af0f-4c64933b8763 tempest-VolumesNegativeTest-107566329 tempest-VolumesNegativeTest-107566329-project] [instance: 1b2c2e3a-393a-4352-afc8-73190dab4a8c] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:46:30.862804 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-ea4a41a2-7371-46bd-af0f-4c64933b8763 tempest-VolumesNegativeTest-107566329 tempest-VolumesNegativeTest-107566329-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:46:30.863254 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-ea4a41a2-7371-46bd-af0f-4c64933b8763 tempest-VolumesNegativeTest-107566329 tempest-VolumesNegativeTest-107566329-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:46:30.864070 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-ea4a41a2-7371-46bd-af0f-4c64933b8763 tempest-VolumesNegativeTest-107566329 tempest-VolumesNegativeTest-107566329-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:46:30.864700 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-ea4a41a2-7371-46bd-af0f-4c64933b8763 tempest-VolumesNegativeTest-107566329 tempest-VolumesNegativeTest-107566329-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:46:30.989934 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-8f6ef7fc-5729-4081-8275-20907ce96b19 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] 10.222.0.45 "DELETE /compute/v2.1/servers/f4a4e6b7-47b1-4de2-8677-4f8e3eb056c2" status: 204 len: 0 microversion: 2.1 time: 0.292025 Jan 21 09:46:30.991066 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 606/1218] 10.222.0.45 () {58 vars in 1238 bytes} [Fri Jan 21 09:46:30 2022] DELETE /compute/v2.1/servers/f4a4e6b7-47b1-4de2-8677-4f8e3eb056c2 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 21 09:46:31.000791 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-98ff9d1a-6bfe-4f1a-ab48-68b762cdbb3e tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:46:31.001332 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-98ff9d1a-6bfe-4f1a-ab48-68b762cdbb3e tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] [instance: f4a4e6b7-47b1-4de2-8677-4f8e3eb056c2] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:46:31.009456 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-98ff9d1a-6bfe-4f1a-ab48-68b762cdbb3e tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:46:31.010800 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-98ff9d1a-6bfe-4f1a-ab48-68b762cdbb3e tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:46:31.016030 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-98ff9d1a-6bfe-4f1a-ab48-68b762cdbb3e tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:46:31.016030 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-98ff9d1a-6bfe-4f1a-ab48-68b762cdbb3e tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:46:31.191748 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-ea4a41a2-7371-46bd-af0f-4c64933b8763 tempest-VolumesNegativeTest-107566329 tempest-VolumesNegativeTest-107566329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf22b24d10674077bef9590d74eb39e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25379f3eeace4e16bd9175662919b699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:46:31.208350 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-ea4a41a2-7371-46bd-af0f-4c64933b8763 tempest-VolumesNegativeTest-107566329 tempest-VolumesNegativeTest-107566329-project] 10.222.0.45 "GET /compute/v2.1/servers/1b2c2e3a-393a-4352-afc8-73190dab4a8c" status: 200 len: 1314 microversion: 2.1 time: 0.361387 Jan 21 09:46:31.208951 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 613/1219] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:46:30 2022] GET /compute/v2.1/servers/1b2c2e3a-393a-4352-afc8-73190dab4a8c => generated 1314 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:46:31.303637 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-98ff9d1a-6bfe-4f1a-ab48-68b762cdbb3e tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aed8f68a416468cb303ae6c59a2203c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ac0334d1e14c29aa6222d547c64b00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:46:31.312169 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-98ff9d1a-6bfe-4f1a-ab48-68b762cdbb3e tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] 10.222.0.45 "GET /compute/v2.1/servers/f4a4e6b7-47b1-4de2-8677-4f8e3eb056c2" status: 200 len: 1568 microversion: 2.1 time: 0.316438 Jan 21 09:46:31.313372 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 607/1220] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:46:30 2022] GET /compute/v2.1/servers/f4a4e6b7-47b1-4de2-8677-4f8e3eb056c2 => generated 1568 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 09:46:32.232128 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-96924aaa-4643-4b90-9da6-9adc85b1d00d tempest-VolumesNegativeTest-107566329 tempest-VolumesNegativeTest-107566329-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:46:32.233319 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-96924aaa-4643-4b90-9da6-9adc85b1d00d tempest-VolumesNegativeTest-107566329 tempest-VolumesNegativeTest-107566329-project] [instance: 1b2c2e3a-393a-4352-afc8-73190dab4a8c] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:46:32.246327 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-96924aaa-4643-4b90-9da6-9adc85b1d00d tempest-VolumesNegativeTest-107566329 tempest-VolumesNegativeTest-107566329-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:46:32.247098 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-96924aaa-4643-4b90-9da6-9adc85b1d00d tempest-VolumesNegativeTest-107566329 tempest-VolumesNegativeTest-107566329-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:46:32.248566 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-96924aaa-4643-4b90-9da6-9adc85b1d00d tempest-VolumesNegativeTest-107566329 tempest-VolumesNegativeTest-107566329-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:46:32.249581 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-96924aaa-4643-4b90-9da6-9adc85b1d00d tempest-VolumesNegativeTest-107566329 tempest-VolumesNegativeTest-107566329-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:46:32.336124 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-dcd48db1-0018-4222-affa-50cd872ddf9a tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:46:32.337389 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-dcd48db1-0018-4222-affa-50cd872ddf9a tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] [instance: f4a4e6b7-47b1-4de2-8677-4f8e3eb056c2] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:46:32.349874 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-dcd48db1-0018-4222-affa-50cd872ddf9a tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:46:32.350867 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-dcd48db1-0018-4222-affa-50cd872ddf9a tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:46:32.352721 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-dcd48db1-0018-4222-affa-50cd872ddf9a tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:46:32.353521 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-dcd48db1-0018-4222-affa-50cd872ddf9a tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:46:32.442800 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-96924aaa-4643-4b90-9da6-9adc85b1d00d tempest-VolumesNegativeTest-107566329 tempest-VolumesNegativeTest-107566329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf22b24d10674077bef9590d74eb39e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25379f3eeace4e16bd9175662919b699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:46:32.454365 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-96924aaa-4643-4b90-9da6-9adc85b1d00d tempest-VolumesNegativeTest-107566329 tempest-VolumesNegativeTest-107566329-project] 10.222.0.45 "GET /compute/v2.1/servers/1b2c2e3a-393a-4352-afc8-73190dab4a8c" status: 200 len: 1314 microversion: 2.1 time: 0.229465 Jan 21 09:46:32.455634 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 614/1221] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:46:32 2022] GET /compute/v2.1/servers/1b2c2e3a-393a-4352-afc8-73190dab4a8c => generated 1314 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:46:32.530654 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-dcd48db1-0018-4222-affa-50cd872ddf9a tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aed8f68a416468cb303ae6c59a2203c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ac0334d1e14c29aa6222d547c64b00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:46:32.539916 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-dcd48db1-0018-4222-affa-50cd872ddf9a tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] 10.222.0.45 "GET /compute/v2.1/servers/f4a4e6b7-47b1-4de2-8677-4f8e3eb056c2" status: 200 len: 1449 microversion: 2.1 time: 0.212527 Jan 21 09:46:32.541421 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 608/1222] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:46:32 2022] GET /compute/v2.1/servers/f4a4e6b7-47b1-4de2-8677-4f8e3eb056c2 => generated 1449 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:46:32.918547 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-ddb053ea-7651-46e3-8b99-1e4035cd303a tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:46:32.919058 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-ddb053ea-7651-46e3-8b99-1e4035cd303a tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] [instance: 325f56a1-8c36-43e5-9896-52f6713a7ba0] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:46:32.922697 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [req-245b56d9-c9ed-4978-963f-c01b23fa9323 req-f3475a30-b809-4088-803e-ff5f87f255a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "325f56a1-8c36-43e5-9896-52f6713a7ba0", "tag": "8a2eff4f-a260-4ac8-8540-0f38c10b4796"}]} {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:46:32.926435 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-ddb053ea-7651-46e3-8b99-1e4035cd303a tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:46:32.926885 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-ddb053ea-7651-46e3-8b99-1e4035cd303a tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:46:32.928575 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 21 09:46:32.928575 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: warnings.warn(msg) Jan 21 09:46:32.928752 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-ddb053ea-7651-46e3-8b99-1e4035cd303a tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:46:32.928752 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-ddb053ea-7651-46e3-8b99-1e4035cd303a tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:46:32.939878 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [req-245b56d9-c9ed-4978-963f-c01b23fa9323 req-f3475a30-b809-4088-803e-ff5f87f255a3 service nova] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:46:32.940674 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [req-245b56d9-c9ed-4978-963f-c01b23fa9323 req-f3475a30-b809-4088-803e-ff5f87f255a3 service nova] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:46:32.955018 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.compute.server_external_events [req-245b56d9-c9ed-4978-963f-c01b23fa9323 req-f3475a30-b809-4088-803e-ff5f87f255a3 service nova] Creating event network-changed:8a2eff4f-a260-4ac8-8540-0f38c10b4796 for instance 325f56a1-8c36-43e5-9896-52f6713a7ba0 on hv-cinder-80403 Jan 21 09:46:32.955690 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-ddb053ea-7651-46e3-8b99-1e4035cd303a tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] [instance: 325f56a1-8c36-43e5-9896-52f6713a7ba0] Going to try to terminate instance {{(pid=123387) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 21 09:46:32.961134 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [req-245b56d9-c9ed-4978-963f-c01b23fa9323 req-f3475a30-b809-4088-803e-ff5f87f255a3 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043963 Jan 21 09:46:32.962073 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 609/1223] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Jan 21 09:46:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jan 21 09:46:33.263874 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-ddb053ea-7651-46e3-8b99-1e4035cd303a tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] 10.222.0.45 "DELETE /compute/v2.1/servers/325f56a1-8c36-43e5-9896-52f6713a7ba0" status: 204 len: 0 microversion: 2.1 time: 0.348349 Jan 21 09:46:33.264841 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 615/1224] 10.222.0.45 () {58 vars in 1238 bytes} [Fri Jan 21 09:46:32 2022] DELETE /compute/v2.1/servers/325f56a1-8c36-43e5-9896-52f6713a7ba0 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 21 09:46:33.277866 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-ee86c8c8-f420-4227-9ea7-1d25d5234bdf tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:46:33.279029 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-ee86c8c8-f420-4227-9ea7-1d25d5234bdf tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] [instance: 325f56a1-8c36-43e5-9896-52f6713a7ba0] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:46:33.286651 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-ee86c8c8-f420-4227-9ea7-1d25d5234bdf tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:46:33.287712 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-ee86c8c8-f420-4227-9ea7-1d25d5234bdf tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:46:33.288750 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-ee86c8c8-f420-4227-9ea7-1d25d5234bdf tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:46:33.289418 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-ee86c8c8-f420-4227-9ea7-1d25d5234bdf tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:46:33.473041 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-14beb810-2d88-4e02-b06e-3e84bb84313f tempest-VolumesNegativeTest-107566329 tempest-VolumesNegativeTest-107566329-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:46:33.473914 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-14beb810-2d88-4e02-b06e-3e84bb84313f tempest-VolumesNegativeTest-107566329 tempest-VolumesNegativeTest-107566329-project] [instance: 1b2c2e3a-393a-4352-afc8-73190dab4a8c] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:46:33.480145 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-14beb810-2d88-4e02-b06e-3e84bb84313f tempest-VolumesNegativeTest-107566329 tempest-VolumesNegativeTest-107566329-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:46:33.480901 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-14beb810-2d88-4e02-b06e-3e84bb84313f tempest-VolumesNegativeTest-107566329 tempest-VolumesNegativeTest-107566329-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:46:33.481950 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-14beb810-2d88-4e02-b06e-3e84bb84313f tempest-VolumesNegativeTest-107566329 tempest-VolumesNegativeTest-107566329-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:46:33.482386 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-14beb810-2d88-4e02-b06e-3e84bb84313f tempest-VolumesNegativeTest-107566329 tempest-VolumesNegativeTest-107566329-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:46:33.571649 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-ee86c8c8-f420-4227-9ea7-1d25d5234bdf tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d53a7fa2cb5498aa916817b82dba77e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515ded26ca114fbf9c6e920362aec64c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:46:33.579366 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-ee86c8c8-f420-4227-9ea7-1d25d5234bdf tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] 10.222.0.45 "GET /compute/v2.1/servers/325f56a1-8c36-43e5-9896-52f6713a7ba0" status: 200 len: 1576 microversion: 2.1 time: 0.308399 Jan 21 09:46:33.591040 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 610/1225] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:46:33 2022] GET /compute/v2.1/servers/325f56a1-8c36-43e5-9896-52f6713a7ba0 => generated 1576 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 09:46:33.600115 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-81b203a4-a1d5-4aa3-bfd4-3c3d1916faea tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:46:33.601659 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-81b203a4-a1d5-4aa3-bfd4-3c3d1916faea tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] [instance: f4a4e6b7-47b1-4de2-8677-4f8e3eb056c2] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:46:33.612307 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-81b203a4-a1d5-4aa3-bfd4-3c3d1916faea tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:46:33.613114 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-81b203a4-a1d5-4aa3-bfd4-3c3d1916faea tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:46:33.614582 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-81b203a4-a1d5-4aa3-bfd4-3c3d1916faea tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:46:33.615387 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-81b203a4-a1d5-4aa3-bfd4-3c3d1916faea tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:46:33.725548 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-14beb810-2d88-4e02-b06e-3e84bb84313f tempest-VolumesNegativeTest-107566329 tempest-VolumesNegativeTest-107566329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf22b24d10674077bef9590d74eb39e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25379f3eeace4e16bd9175662919b699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:46:33.734682 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-14beb810-2d88-4e02-b06e-3e84bb84313f tempest-VolumesNegativeTest-107566329 tempest-VolumesNegativeTest-107566329-project] 10.222.0.45 "GET /compute/v2.1/servers/1b2c2e3a-393a-4352-afc8-73190dab4a8c" status: 200 len: 1314 microversion: 2.1 time: 0.265884 Jan 21 09:46:33.735304 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 616/1226] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:46:33 2022] GET /compute/v2.1/servers/1b2c2e3a-393a-4352-afc8-73190dab4a8c => generated 1314 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 09:46:33.812884 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-81b203a4-a1d5-4aa3-bfd4-3c3d1916faea tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aed8f68a416468cb303ae6c59a2203c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ac0334d1e14c29aa6222d547c64b00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:46:33.822146 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-81b203a4-a1d5-4aa3-bfd4-3c3d1916faea tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] 10.222.0.45 "GET /compute/v2.1/servers/f4a4e6b7-47b1-4de2-8677-4f8e3eb056c2" status: 200 len: 1449 microversion: 2.1 time: 0.229103 Jan 21 09:46:33.822746 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 611/1227] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:46:33 2022] GET /compute/v2.1/servers/f4a4e6b7-47b1-4de2-8677-4f8e3eb056c2 => generated 1449 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:46:33.900161 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [req-21d06144-41fc-47f8-bc35-fde5a4150333 req-69a8904e-06e0-4abe-8448-826574d1c3f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b2c2e3a-393a-4352-afc8-73190dab4a8c", "name": "network-vif-plugged", "status": "completed", "tag": "c3b0aa84-3336-4a8d-b90c-878574a4383e"}]} {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:46:33.901825 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 21 09:46:33.901825 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: warnings.warn(msg) Jan 21 09:46:33.909051 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [req-21d06144-41fc-47f8-bc35-fde5a4150333 req-69a8904e-06e0-4abe-8448-826574d1c3f3 service nova] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:46:33.909523 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [req-21d06144-41fc-47f8-bc35-fde5a4150333 req-69a8904e-06e0-4abe-8448-826574d1c3f3 service nova] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:46:33.921449 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.compute.server_external_events [req-21d06144-41fc-47f8-bc35-fde5a4150333 req-69a8904e-06e0-4abe-8448-826574d1c3f3 service nova] Creating event network-vif-plugged:c3b0aa84-3336-4a8d-b90c-878574a4383e for instance 1b2c2e3a-393a-4352-afc8-73190dab4a8c on hv-cinder-80403 Jan 21 09:46:33.927400 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [req-21d06144-41fc-47f8-bc35-fde5a4150333 req-69a8904e-06e0-4abe-8448-826574d1c3f3 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031236 Jan 21 09:46:33.928551 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 617/1228] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Jan 21 09:46:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 09:46:34.598163 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-a5c2835a-2183-4cbc-9921-040a10d41e61 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:46:34.598706 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-a5c2835a-2183-4cbc-9921-040a10d41e61 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] [instance: 325f56a1-8c36-43e5-9896-52f6713a7ba0] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:46:34.606106 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-a5c2835a-2183-4cbc-9921-040a10d41e61 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:46:34.606579 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-a5c2835a-2183-4cbc-9921-040a10d41e61 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:46:34.607355 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-a5c2835a-2183-4cbc-9921-040a10d41e61 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:46:34.607810 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-a5c2835a-2183-4cbc-9921-040a10d41e61 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:46:34.748949 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-a5c2835a-2183-4cbc-9921-040a10d41e61 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d53a7fa2cb5498aa916817b82dba77e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515ded26ca114fbf9c6e920362aec64c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:46:34.757394 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-a5c2835a-2183-4cbc-9921-040a10d41e61 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] 10.222.0.45 "GET /compute/v2.1/servers/325f56a1-8c36-43e5-9896-52f6713a7ba0" status: 200 len: 1458 microversion: 2.1 time: 0.163194 Jan 21 09:46:34.757973 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 612/1229] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:46:34 2022] GET /compute/v2.1/servers/325f56a1-8c36-43e5-9896-52f6713a7ba0 => generated 1458 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:46:34.764496 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-098046c8-de22-4bf9-8555-a2ac15ba0bf7 tempest-VolumesNegativeTest-107566329 tempest-VolumesNegativeTest-107566329-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:46:34.765243 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-098046c8-de22-4bf9-8555-a2ac15ba0bf7 tempest-VolumesNegativeTest-107566329 tempest-VolumesNegativeTest-107566329-project] [instance: 1b2c2e3a-393a-4352-afc8-73190dab4a8c] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:46:34.772057 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-098046c8-de22-4bf9-8555-a2ac15ba0bf7 tempest-VolumesNegativeTest-107566329 tempest-VolumesNegativeTest-107566329-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:46:34.772698 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-098046c8-de22-4bf9-8555-a2ac15ba0bf7 tempest-VolumesNegativeTest-107566329 tempest-VolumesNegativeTest-107566329-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:46:34.773361 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-098046c8-de22-4bf9-8555-a2ac15ba0bf7 tempest-VolumesNegativeTest-107566329 tempest-VolumesNegativeTest-107566329-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:46:34.773847 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-098046c8-de22-4bf9-8555-a2ac15ba0bf7 tempest-VolumesNegativeTest-107566329 tempest-VolumesNegativeTest-107566329-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:46:34.839568 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-d7383965-5955-4894-a9fd-d1f8ce881475 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:46:34.840332 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-d7383965-5955-4894-a9fd-d1f8ce881475 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] [instance: f4a4e6b7-47b1-4de2-8677-4f8e3eb056c2] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:46:34.847054 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-d7383965-5955-4894-a9fd-d1f8ce881475 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:46:34.847495 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-d7383965-5955-4894-a9fd-d1f8ce881475 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:46:34.848364 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-d7383965-5955-4894-a9fd-d1f8ce881475 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:46:34.848736 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-d7383965-5955-4894-a9fd-d1f8ce881475 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:46:34.943936 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-098046c8-de22-4bf9-8555-a2ac15ba0bf7 tempest-VolumesNegativeTest-107566329 tempest-VolumesNegativeTest-107566329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf22b24d10674077bef9590d74eb39e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25379f3eeace4e16bd9175662919b699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:46:34.957184 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-098046c8-de22-4bf9-8555-a2ac15ba0bf7 tempest-VolumesNegativeTest-107566329 tempest-VolumesNegativeTest-107566329-project] 10.222.0.45 "GET /compute/v2.1/servers/1b2c2e3a-393a-4352-afc8-73190dab4a8c" status: 200 len: 1314 microversion: 2.1 time: 0.196665 Jan 21 09:46:34.966794 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 618/1230] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:46:34 2022] GET /compute/v2.1/servers/1b2c2e3a-393a-4352-afc8-73190dab4a8c => generated 1314 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:46:35.018764 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-d7383965-5955-4894-a9fd-d1f8ce881475 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aed8f68a416468cb303ae6c59a2203c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ac0334d1e14c29aa6222d547c64b00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:46:35.026598 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-d7383965-5955-4894-a9fd-d1f8ce881475 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] 10.222.0.45 "GET /compute/v2.1/servers/f4a4e6b7-47b1-4de2-8677-4f8e3eb056c2" status: 200 len: 1449 microversion: 2.1 time: 0.190658 Jan 21 09:46:35.027177 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 613/1231] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:46:34 2022] GET /compute/v2.1/servers/f4a4e6b7-47b1-4de2-8677-4f8e3eb056c2 => generated 1449 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:46:35.775807 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-7e5e963d-523a-4bd2-9862-65530781f02c tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:46:35.776415 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-7e5e963d-523a-4bd2-9862-65530781f02c tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] [instance: 325f56a1-8c36-43e5-9896-52f6713a7ba0] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:46:35.783772 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-7e5e963d-523a-4bd2-9862-65530781f02c tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:46:35.784218 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-7e5e963d-523a-4bd2-9862-65530781f02c tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:46:35.785050 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-7e5e963d-523a-4bd2-9862-65530781f02c tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:46:35.785527 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-7e5e963d-523a-4bd2-9862-65530781f02c tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:46:35.936567 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-7e5e963d-523a-4bd2-9862-65530781f02c tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d53a7fa2cb5498aa916817b82dba77e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515ded26ca114fbf9c6e920362aec64c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:46:35.944665 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-7e5e963d-523a-4bd2-9862-65530781f02c tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] 10.222.0.45 "GET /compute/v2.1/servers/325f56a1-8c36-43e5-9896-52f6713a7ba0" status: 200 len: 1458 microversion: 2.1 time: 0.172426 Jan 21 09:46:35.945313 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 619/1232] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:46:35 2022] GET /compute/v2.1/servers/325f56a1-8c36-43e5-9896-52f6713a7ba0 => generated 1458 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:46:35.962183 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [req-6a6651ea-9a02-45c6-a89c-5c61b36193cc req-707b4754-9d1a-4bdf-9738-0051562ba57c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4a4e6b7-47b1-4de2-8677-4f8e3eb056c2", "name": "network-vif-unplugged", "status": "completed", "tag": "0e43678c-54de-414e-81b5-5773897a97f4"}]} {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:46:35.963761 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 21 09:46:35.963761 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: warnings.warn(msg) Jan 21 09:46:35.972679 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [req-6a6651ea-9a02-45c6-a89c-5c61b36193cc req-707b4754-9d1a-4bdf-9738-0051562ba57c service nova] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:46:35.973191 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [req-6a6651ea-9a02-45c6-a89c-5c61b36193cc req-707b4754-9d1a-4bdf-9738-0051562ba57c service nova] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:46:35.975246 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-d76f4d24-8b22-4aec-90ad-3d88f2caf42b tempest-VolumesNegativeTest-107566329 tempest-VolumesNegativeTest-107566329-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:46:35.975882 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-d76f4d24-8b22-4aec-90ad-3d88f2caf42b tempest-VolumesNegativeTest-107566329 tempest-VolumesNegativeTest-107566329-project] [instance: 1b2c2e3a-393a-4352-afc8-73190dab4a8c] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:46:35.982403 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-d76f4d24-8b22-4aec-90ad-3d88f2caf42b tempest-VolumesNegativeTest-107566329 tempest-VolumesNegativeTest-107566329-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:46:35.982848 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-d76f4d24-8b22-4aec-90ad-3d88f2caf42b tempest-VolumesNegativeTest-107566329 tempest-VolumesNegativeTest-107566329-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:46:35.983656 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-d76f4d24-8b22-4aec-90ad-3d88f2caf42b tempest-VolumesNegativeTest-107566329 tempest-VolumesNegativeTest-107566329-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:46:35.984094 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-d76f4d24-8b22-4aec-90ad-3d88f2caf42b tempest-VolumesNegativeTest-107566329 tempest-VolumesNegativeTest-107566329-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:46:35.989399 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.compute.server_external_events [req-6a6651ea-9a02-45c6-a89c-5c61b36193cc req-707b4754-9d1a-4bdf-9738-0051562ba57c service nova] Creating event network-vif-unplugged:0e43678c-54de-414e-81b5-5773897a97f4 for instance f4a4e6b7-47b1-4de2-8677-4f8e3eb056c2 on hv-cinder-80403 Jan 21 09:46:35.995229 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [req-6a6651ea-9a02-45c6-a89c-5c61b36193cc req-707b4754-9d1a-4bdf-9738-0051562ba57c service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036332 Jan 21 09:46:35.995848 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 614/1233] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Jan 21 09:46:35 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 09:46:36.044951 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-63cca569-1369-479c-a691-a1c55b45ab15 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:46:36.045800 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-63cca569-1369-479c-a691-a1c55b45ab15 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] [instance: f4a4e6b7-47b1-4de2-8677-4f8e3eb056c2] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:46:36.052778 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-63cca569-1369-479c-a691-a1c55b45ab15 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:46:36.053249 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-63cca569-1369-479c-a691-a1c55b45ab15 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:46:36.054078 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-63cca569-1369-479c-a691-a1c55b45ab15 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:46:36.054520 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-63cca569-1369-479c-a691-a1c55b45ab15 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:46:36.185378 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-d76f4d24-8b22-4aec-90ad-3d88f2caf42b tempest-VolumesNegativeTest-107566329 tempest-VolumesNegativeTest-107566329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf22b24d10674077bef9590d74eb39e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25379f3eeace4e16bd9175662919b699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:46:36.194009 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-d76f4d24-8b22-4aec-90ad-3d88f2caf42b tempest-VolumesNegativeTest-107566329 tempest-VolumesNegativeTest-107566329-project] 10.222.0.45 "GET /compute/v2.1/servers/1b2c2e3a-393a-4352-afc8-73190dab4a8c" status: 200 len: 1463 microversion: 2.1 time: 0.222425 Jan 21 09:46:36.194810 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 620/1234] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:46:35 2022] GET /compute/v2.1/servers/1b2c2e3a-393a-4352-afc8-73190dab4a8c => generated 1463 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 09:46:36.238928 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-63cca569-1369-479c-a691-a1c55b45ab15 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aed8f68a416468cb303ae6c59a2203c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ac0334d1e14c29aa6222d547c64b00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:46:36.239136 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-5ca89507-1bc4-4e16-a635-487c6732e03b tempest-VolumesNegativeTest-107566329 tempest-VolumesNegativeTest-107566329-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:46:36.239671 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-5ca89507-1bc4-4e16-a635-487c6732e03b tempest-VolumesNegativeTest-107566329 tempest-VolumesNegativeTest-107566329-project] [instance: 1b2c2e3a-393a-4352-afc8-73190dab4a8c] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:46:36.246377 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-5ca89507-1bc4-4e16-a635-487c6732e03b tempest-VolumesNegativeTest-107566329 tempest-VolumesNegativeTest-107566329-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:46:36.246822 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-5ca89507-1bc4-4e16-a635-487c6732e03b tempest-VolumesNegativeTest-107566329 tempest-VolumesNegativeTest-107566329-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:46:36.247627 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-5ca89507-1bc4-4e16-a635-487c6732e03b tempest-VolumesNegativeTest-107566329 tempest-VolumesNegativeTest-107566329-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:46:36.248066 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-5ca89507-1bc4-4e16-a635-487c6732e03b tempest-VolumesNegativeTest-107566329 tempest-VolumesNegativeTest-107566329-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:46:36.248702 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-63cca569-1369-479c-a691-a1c55b45ab15 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] 10.222.0.45 "GET /compute/v2.1/servers/f4a4e6b7-47b1-4de2-8677-4f8e3eb056c2" status: 200 len: 1449 microversion: 2.1 time: 0.207779 Jan 21 09:46:36.249320 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 615/1235] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:46:36 2022] GET /compute/v2.1/servers/f4a4e6b7-47b1-4de2-8677-4f8e3eb056c2 => generated 1449 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 09:46:36.279754 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-5ca89507-1bc4-4e16-a635-487c6732e03b tempest-VolumesNegativeTest-107566329 tempest-VolumesNegativeTest-107566329-project] [instance: 1b2c2e3a-393a-4352-afc8-73190dab4a8c] Going to try to terminate instance {{(pid=123387) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 21 09:46:36.594274 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-5ca89507-1bc4-4e16-a635-487c6732e03b tempest-VolumesNegativeTest-107566329 tempest-VolumesNegativeTest-107566329-project] 10.222.0.45 "DELETE /compute/v2.1/servers/1b2c2e3a-393a-4352-afc8-73190dab4a8c" status: 204 len: 0 microversion: 2.1 time: 0.359585 Jan 21 09:46:36.594834 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 621/1236] 10.222.0.45 () {58 vars in 1238 bytes} [Fri Jan 21 09:46:36 2022] DELETE /compute/v2.1/servers/1b2c2e3a-393a-4352-afc8-73190dab4a8c => generated 0 bytes in 361 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jan 21 09:46:36.608166 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-bc659ab0-917b-4985-a1cd-dc53cb2c4729 tempest-VolumesNegativeTest-107566329 tempest-VolumesNegativeTest-107566329-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:46:36.609321 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-bc659ab0-917b-4985-a1cd-dc53cb2c4729 tempest-VolumesNegativeTest-107566329 tempest-VolumesNegativeTest-107566329-project] [instance: 1b2c2e3a-393a-4352-afc8-73190dab4a8c] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:46:36.619646 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-bc659ab0-917b-4985-a1cd-dc53cb2c4729 tempest-VolumesNegativeTest-107566329 tempest-VolumesNegativeTest-107566329-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:46:36.620450 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-bc659ab0-917b-4985-a1cd-dc53cb2c4729 tempest-VolumesNegativeTest-107566329 tempest-VolumesNegativeTest-107566329-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:46:36.622025 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-bc659ab0-917b-4985-a1cd-dc53cb2c4729 tempest-VolumesNegativeTest-107566329 tempest-VolumesNegativeTest-107566329-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:46:36.622664 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-bc659ab0-917b-4985-a1cd-dc53cb2c4729 tempest-VolumesNegativeTest-107566329 tempest-VolumesNegativeTest-107566329-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:46:36.779986 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-bc659ab0-917b-4985-a1cd-dc53cb2c4729 tempest-VolumesNegativeTest-107566329 tempest-VolumesNegativeTest-107566329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf22b24d10674077bef9590d74eb39e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25379f3eeace4e16bd9175662919b699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:46:36.789084 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-bc659ab0-917b-4985-a1cd-dc53cb2c4729 tempest-VolumesNegativeTest-107566329 tempest-VolumesNegativeTest-107566329-project] 10.222.0.45 "GET /compute/v2.1/servers/1b2c2e3a-393a-4352-afc8-73190dab4a8c" status: 200 len: 1469 microversion: 2.1 time: 0.187080 Jan 21 09:46:36.789755 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 616/1237] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:46:36 2022] GET /compute/v2.1/servers/1b2c2e3a-393a-4352-afc8-73190dab4a8c => generated 1469 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:46:36.962498 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-20c73d7f-5abd-4d68-89bf-ac331223d55b tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:46:36.963207 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-20c73d7f-5abd-4d68-89bf-ac331223d55b tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] [instance: 325f56a1-8c36-43e5-9896-52f6713a7ba0] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:46:36.969847 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-20c73d7f-5abd-4d68-89bf-ac331223d55b tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:46:36.970442 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-20c73d7f-5abd-4d68-89bf-ac331223d55b tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:46:36.971239 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-20c73d7f-5abd-4d68-89bf-ac331223d55b tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:46:36.971669 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-20c73d7f-5abd-4d68-89bf-ac331223d55b tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:46:37.111152 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-20c73d7f-5abd-4d68-89bf-ac331223d55b tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d53a7fa2cb5498aa916817b82dba77e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515ded26ca114fbf9c6e920362aec64c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:46:37.119434 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-20c73d7f-5abd-4d68-89bf-ac331223d55b tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] 10.222.0.45 "GET /compute/v2.1/servers/325f56a1-8c36-43e5-9896-52f6713a7ba0" status: 200 len: 1458 microversion: 2.1 time: 0.160960 Jan 21 09:46:37.120003 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 622/1238] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:46:36 2022] GET /compute/v2.1/servers/325f56a1-8c36-43e5-9896-52f6713a7ba0 => generated 1458 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:46:37.266250 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-cffd5625-fd76-475e-8dbe-322ab3bd2668 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:46:37.266840 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-cffd5625-fd76-475e-8dbe-322ab3bd2668 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] [instance: f4a4e6b7-47b1-4de2-8677-4f8e3eb056c2] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:46:37.273872 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-cffd5625-fd76-475e-8dbe-322ab3bd2668 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:46:37.274330 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-cffd5625-fd76-475e-8dbe-322ab3bd2668 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:46:37.275174 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-cffd5625-fd76-475e-8dbe-322ab3bd2668 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:46:37.275615 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-cffd5625-fd76-475e-8dbe-322ab3bd2668 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:46:37.461223 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-cffd5625-fd76-475e-8dbe-322ab3bd2668 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aed8f68a416468cb303ae6c59a2203c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ac0334d1e14c29aa6222d547c64b00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:46:37.469340 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-cffd5625-fd76-475e-8dbe-322ab3bd2668 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] 10.222.0.45 "GET /compute/v2.1/servers/f4a4e6b7-47b1-4de2-8677-4f8e3eb056c2" status: 200 len: 1449 microversion: 2.1 time: 0.206784 Jan 21 09:46:37.470476 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 617/1239] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:46:37 2022] GET /compute/v2.1/servers/f4a4e6b7-47b1-4de2-8677-4f8e3eb056c2 => generated 1449 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 09:46:37.810522 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-b60251b9-1f1b-40d8-8299-1e114035068d tempest-VolumesNegativeTest-107566329 tempest-VolumesNegativeTest-107566329-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:46:37.811470 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-b60251b9-1f1b-40d8-8299-1e114035068d tempest-VolumesNegativeTest-107566329 tempest-VolumesNegativeTest-107566329-project] [instance: 1b2c2e3a-393a-4352-afc8-73190dab4a8c] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:46:37.822714 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-b60251b9-1f1b-40d8-8299-1e114035068d tempest-VolumesNegativeTest-107566329 tempest-VolumesNegativeTest-107566329-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:46:37.823159 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-b60251b9-1f1b-40d8-8299-1e114035068d tempest-VolumesNegativeTest-107566329 tempest-VolumesNegativeTest-107566329-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:46:37.824110 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-b60251b9-1f1b-40d8-8299-1e114035068d tempest-VolumesNegativeTest-107566329 tempest-VolumesNegativeTest-107566329-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:46:37.824543 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-b60251b9-1f1b-40d8-8299-1e114035068d tempest-VolumesNegativeTest-107566329 tempest-VolumesNegativeTest-107566329-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:46:38.020262 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [req-d7490088-ba99-4fa5-b534-335d55629fc8 req-4d7cb0e7-0227-4208-ac3b-5fcf73d7cac4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "325f56a1-8c36-43e5-9896-52f6713a7ba0", "name": "network-vif-unplugged", "status": "completed", "tag": "8a2eff4f-a260-4ac8-8540-0f38c10b4796"}]} {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:46:38.022556 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 21 09:46:38.022556 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: warnings.warn(msg) Jan 21 09:46:38.036441 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [req-d7490088-ba99-4fa5-b534-335d55629fc8 req-4d7cb0e7-0227-4208-ac3b-5fcf73d7cac4 service nova] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:46:38.037425 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [req-d7490088-ba99-4fa5-b534-335d55629fc8 req-4d7cb0e7-0227-4208-ac3b-5fcf73d7cac4 service nova] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:46:38.055598 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.compute.server_external_events [req-d7490088-ba99-4fa5-b534-335d55629fc8 req-4d7cb0e7-0227-4208-ac3b-5fcf73d7cac4 service nova] Creating event network-vif-unplugged:8a2eff4f-a260-4ac8-8540-0f38c10b4796 for instance 325f56a1-8c36-43e5-9896-52f6713a7ba0 on hv-cinder-80403 Jan 21 09:46:38.061889 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [req-d7490088-ba99-4fa5-b534-335d55629fc8 req-4d7cb0e7-0227-4208-ac3b-5fcf73d7cac4 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044920 Jan 21 09:46:38.062564 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 618/1240] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Jan 21 09:46:38 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 09:46:38.149564 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-adc916ac-3ede-4e9e-9fe0-035f90171602 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:46:38.151014 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-adc916ac-3ede-4e9e-9fe0-035f90171602 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] [instance: 325f56a1-8c36-43e5-9896-52f6713a7ba0] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:46:38.167914 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-adc916ac-3ede-4e9e-9fe0-035f90171602 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:46:38.169003 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-adc916ac-3ede-4e9e-9fe0-035f90171602 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:46:38.170997 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-adc916ac-3ede-4e9e-9fe0-035f90171602 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:46:38.172035 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-adc916ac-3ede-4e9e-9fe0-035f90171602 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:46:38.246496 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-b60251b9-1f1b-40d8-8299-1e114035068d tempest-VolumesNegativeTest-107566329 tempest-VolumesNegativeTest-107566329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf22b24d10674077bef9590d74eb39e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25379f3eeace4e16bd9175662919b699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:46:38.262781 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-b60251b9-1f1b-40d8-8299-1e114035068d tempest-VolumesNegativeTest-107566329 tempest-VolumesNegativeTest-107566329-project] 10.222.0.45 "GET /compute/v2.1/servers/1b2c2e3a-393a-4352-afc8-73190dab4a8c" status: 200 len: 1469 microversion: 2.1 time: 0.458380 Jan 21 09:46:38.263367 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 623/1241] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:46:37 2022] GET /compute/v2.1/servers/1b2c2e3a-393a-4352-afc8-73190dab4a8c => generated 1469 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:46:38.492864 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-891d17d7-05ce-4716-a6aa-ddd382af1265 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:46:38.494355 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-891d17d7-05ce-4716-a6aa-ddd382af1265 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] [instance: f4a4e6b7-47b1-4de2-8677-4f8e3eb056c2] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:46:38.504211 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-891d17d7-05ce-4716-a6aa-ddd382af1265 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:46:38.504855 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-891d17d7-05ce-4716-a6aa-ddd382af1265 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:46:38.506544 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-891d17d7-05ce-4716-a6aa-ddd382af1265 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:46:38.507713 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-891d17d7-05ce-4716-a6aa-ddd382af1265 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:46:38.663852 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-891d17d7-05ce-4716-a6aa-ddd382af1265 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aed8f68a416468cb303ae6c59a2203c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ac0334d1e14c29aa6222d547c64b00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:46:38.672840 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-891d17d7-05ce-4716-a6aa-ddd382af1265 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] 10.222.0.45 "GET /compute/v2.1/servers/f4a4e6b7-47b1-4de2-8677-4f8e3eb056c2" status: 200 len: 1382 microversion: 2.1 time: 0.187305 Jan 21 09:46:38.684848 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 624/1242] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:46:38 2022] GET /compute/v2.1/servers/f4a4e6b7-47b1-4de2-8677-4f8e3eb056c2 => generated 1382 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:46:38.718069 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [req-8ec21601-58a9-4870-b5df-c9551194ff53 req-de66548a-1fe1-4bd6-87b3-feac470398c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4a4e6b7-47b1-4de2-8677-4f8e3eb056c2", "name": "network-vif-deleted", "tag": "0e43678c-54de-414e-81b5-5773897a97f4"}]} {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:46:38.718306 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-adc916ac-3ede-4e9e-9fe0-035f90171602 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d53a7fa2cb5498aa916817b82dba77e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515ded26ca114fbf9c6e920362aec64c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:46:38.721549 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 21 09:46:38.721549 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: warnings.warn(msg) Jan 21 09:46:38.729488 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-adc916ac-3ede-4e9e-9fe0-035f90171602 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] 10.222.0.45 "GET /compute/v2.1/servers/325f56a1-8c36-43e5-9896-52f6713a7ba0" status: 200 len: 1458 microversion: 2.1 time: 0.589203 Jan 21 09:46:38.735636 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 619/1243] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:46:38 2022] GET /compute/v2.1/servers/325f56a1-8c36-43e5-9896-52f6713a7ba0 => generated 1458 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 09:46:38.738530 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [req-8ec21601-58a9-4870-b5df-c9551194ff53 req-de66548a-1fe1-4bd6-87b3-feac470398c2 service nova] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:46:38.738978 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [req-8ec21601-58a9-4870-b5df-c9551194ff53 req-de66548a-1fe1-4bd6-87b3-feac470398c2 service nova] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:46:38.766681 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.compute.server_external_events [req-8ec21601-58a9-4870-b5df-c9551194ff53 req-de66548a-1fe1-4bd6-87b3-feac470398c2 service nova] Creating event network-vif-deleted:0e43678c-54de-414e-81b5-5773897a97f4 for instance f4a4e6b7-47b1-4de2-8677-4f8e3eb056c2 on hv-cinder-80403 Jan 21 09:46:38.773240 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [req-8ec21601-58a9-4870-b5df-c9551194ff53 req-de66548a-1fe1-4bd6-87b3-feac470398c2 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063882 Jan 21 09:46:38.773779 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 625/1244] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Jan 21 09:46:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 09:46:38.812008 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [req-bcfa4650-f640-494e-b8bd-3c2180b1230d req-78a4bf00-59dc-4e96-9d02-f4d6f493bc2a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b2c2e3a-393a-4352-afc8-73190dab4a8c", "name": "network-vif-deleted", "tag": "c3b0aa84-3336-4a8d-b90c-878574a4383e"}]} {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:46:38.814928 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 21 09:46:38.814928 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: warnings.warn(msg) Jan 21 09:46:38.823271 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [req-bcfa4650-f640-494e-b8bd-3c2180b1230d req-78a4bf00-59dc-4e96-9d02-f4d6f493bc2a service nova] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:46:38.823594 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [req-bcfa4650-f640-494e-b8bd-3c2180b1230d req-78a4bf00-59dc-4e96-9d02-f4d6f493bc2a service nova] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:46:38.850193 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.compute.server_external_events [req-bcfa4650-f640-494e-b8bd-3c2180b1230d req-78a4bf00-59dc-4e96-9d02-f4d6f493bc2a service nova] Creating event network-vif-deleted:c3b0aa84-3336-4a8d-b90c-878574a4383e for instance 1b2c2e3a-393a-4352-afc8-73190dab4a8c on hv-cinder-80403 Jan 21 09:46:38.858492 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [req-bcfa4650-f640-494e-b8bd-3c2180b1230d req-78a4bf00-59dc-4e96-9d02-f4d6f493bc2a service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049577 Jan 21 09:46:38.859457 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 620/1245] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Jan 21 09:46:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 09:46:39.281970 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-ebd2cd4e-6d87-42ad-acc8-74d80c404286 tempest-VolumesNegativeTest-107566329 tempest-VolumesNegativeTest-107566329-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:46:39.283903 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-ebd2cd4e-6d87-42ad-acc8-74d80c404286 tempest-VolumesNegativeTest-107566329 tempest-VolumesNegativeTest-107566329-project] [instance: 1b2c2e3a-393a-4352-afc8-73190dab4a8c] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:46:39.291020 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-ebd2cd4e-6d87-42ad-acc8-74d80c404286 tempest-VolumesNegativeTest-107566329 tempest-VolumesNegativeTest-107566329-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:46:39.291465 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-ebd2cd4e-6d87-42ad-acc8-74d80c404286 tempest-VolumesNegativeTest-107566329 tempest-VolumesNegativeTest-107566329-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:46:39.292265 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-ebd2cd4e-6d87-42ad-acc8-74d80c404286 tempest-VolumesNegativeTest-107566329 tempest-VolumesNegativeTest-107566329-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:46:39.292749 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-ebd2cd4e-6d87-42ad-acc8-74d80c404286 tempest-VolumesNegativeTest-107566329 tempest-VolumesNegativeTest-107566329-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:46:39.327999 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-ebd2cd4e-6d87-42ad-acc8-74d80c404286 tempest-VolumesNegativeTest-107566329 tempest-VolumesNegativeTest-107566329-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:46:39.328455 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-ebd2cd4e-6d87-42ad-acc8-74d80c404286 tempest-VolumesNegativeTest-107566329 tempest-VolumesNegativeTest-107566329-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:46:39.328905 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.objects.instance [None req-ebd2cd4e-6d87-42ad-acc8-74d80c404286 tempest-VolumesNegativeTest-107566329 tempest-VolumesNegativeTest-107566329-project] Lazy-loading 'fault' on Instance uuid 1b2c2e3a-393a-4352-afc8-73190dab4a8c {{(pid=123387) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 21 09:46:39.388536 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-ebd2cd4e-6d87-42ad-acc8-74d80c404286 tempest-VolumesNegativeTest-107566329 tempest-VolumesNegativeTest-107566329-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf22b24d10674077bef9590d74eb39e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25379f3eeace4e16bd9175662919b699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:46:39.403194 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-ebd2cd4e-6d87-42ad-acc8-74d80c404286 tempest-VolumesNegativeTest-107566329 tempest-VolumesNegativeTest-107566329-project] 10.222.0.45 "GET /compute/v2.1/servers/1b2c2e3a-393a-4352-afc8-73190dab4a8c" status: 200 len: 1304 microversion: 2.1 time: 0.125547 Jan 21 09:46:39.404674 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 626/1246] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:46:39 2022] GET /compute/v2.1/servers/1b2c2e3a-393a-4352-afc8-73190dab4a8c => generated 1304 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:46:39.696202 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-bbce2457-b4c8-4fbe-bae3-5f6d21e1a6aa tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:46:39.696760 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-bbce2457-b4c8-4fbe-bae3-5f6d21e1a6aa tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] [instance: f4a4e6b7-47b1-4de2-8677-4f8e3eb056c2] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:46:39.703597 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-bbce2457-b4c8-4fbe-bae3-5f6d21e1a6aa tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:46:39.704047 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-bbce2457-b4c8-4fbe-bae3-5f6d21e1a6aa tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:46:39.705520 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-bbce2457-b4c8-4fbe-bae3-5f6d21e1a6aa tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:46:39.706059 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-bbce2457-b4c8-4fbe-bae3-5f6d21e1a6aa tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:46:39.746604 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-bbce2457-b4c8-4fbe-bae3-5f6d21e1a6aa tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:46:39.747287 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-bbce2457-b4c8-4fbe-bae3-5f6d21e1a6aa tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:46:39.747651 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.objects.instance [None req-bbce2457-b4c8-4fbe-bae3-5f6d21e1a6aa tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Lazy-loading 'fault' on Instance uuid f4a4e6b7-47b1-4de2-8677-4f8e3eb056c2 {{(pid=123386) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 21 09:46:39.749928 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-5c2bde32-4e87-423b-b6a5-bf1b5f26d5f6 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:46:39.751485 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-5c2bde32-4e87-423b-b6a5-bf1b5f26d5f6 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] [instance: 325f56a1-8c36-43e5-9896-52f6713a7ba0] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:46:39.761340 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-5c2bde32-4e87-423b-b6a5-bf1b5f26d5f6 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:46:39.761797 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-5c2bde32-4e87-423b-b6a5-bf1b5f26d5f6 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:46:39.762612 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-5c2bde32-4e87-423b-b6a5-bf1b5f26d5f6 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:46:39.763057 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-5c2bde32-4e87-423b-b6a5-bf1b5f26d5f6 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:46:39.791710 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-bbce2457-b4c8-4fbe-bae3-5f6d21e1a6aa tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6aed8f68a416468cb303ae6c59a2203c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2ac0334d1e14c29aa6222d547c64b00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:46:39.802827 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-bbce2457-b4c8-4fbe-bae3-5f6d21e1a6aa tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] 10.222.0.45 "GET /compute/v2.1/servers/f4a4e6b7-47b1-4de2-8677-4f8e3eb056c2" status: 200 len: 1224 microversion: 2.1 time: 0.108274 Jan 21 09:46:39.802827 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 621/1247] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:46:39 2022] GET /compute/v2.1/servers/f4a4e6b7-47b1-4de2-8677-4f8e3eb056c2 => generated 1224 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:46:39.819168 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-5c2bde32-4e87-423b-b6a5-bf1b5f26d5f6 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:46:39.819678 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-5c2bde32-4e87-423b-b6a5-bf1b5f26d5f6 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:46:39.820139 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.objects.instance [None req-5c2bde32-4e87-423b-b6a5-bf1b5f26d5f6 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lazy-loading 'fault' on Instance uuid 325f56a1-8c36-43e5-9896-52f6713a7ba0 {{(pid=123387) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jan 21 09:46:39.863126 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-5c2bde32-4e87-423b-b6a5-bf1b5f26d5f6 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d53a7fa2cb5498aa916817b82dba77e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515ded26ca114fbf9c6e920362aec64c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:46:39.871297 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-5c2bde32-4e87-423b-b6a5-bf1b5f26d5f6 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] 10.222.0.45 "GET /compute/v2.1/servers/325f56a1-8c36-43e5-9896-52f6713a7ba0" status: 200 len: 1229 microversion: 2.1 time: 0.127977 Jan 21 09:46:39.874142 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 627/1248] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:46:39 2022] GET /compute/v2.1/servers/325f56a1-8c36-43e5-9896-52f6713a7ba0 => generated 1229 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:46:40.430163 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-20691770-3c83-4c3c-b3ea-575f32fa2269 tempest-VolumesNegativeTest-107566329 tempest-VolumesNegativeTest-107566329-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:46:40.430817 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-20691770-3c83-4c3c-b3ea-575f32fa2269 tempest-VolumesNegativeTest-107566329 tempest-VolumesNegativeTest-107566329-project] [instance: 1b2c2e3a-393a-4352-afc8-73190dab4a8c] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:46:40.437162 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-20691770-3c83-4c3c-b3ea-575f32fa2269 tempest-VolumesNegativeTest-107566329 tempest-VolumesNegativeTest-107566329-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:46:40.437629 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-20691770-3c83-4c3c-b3ea-575f32fa2269 tempest-VolumesNegativeTest-107566329 tempest-VolumesNegativeTest-107566329-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:46:40.438441 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-20691770-3c83-4c3c-b3ea-575f32fa2269 tempest-VolumesNegativeTest-107566329 tempest-VolumesNegativeTest-107566329-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:46:40.439599 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-20691770-3c83-4c3c-b3ea-575f32fa2269 tempest-VolumesNegativeTest-107566329 tempest-VolumesNegativeTest-107566329-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:46:40.454880 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.wsgi [None req-20691770-3c83-4c3c-b3ea-575f32fa2269 tempest-VolumesNegativeTest-107566329 tempest-VolumesNegativeTest-107566329-project] HTTP exception thrown: Instance 1b2c2e3a-393a-4352-afc8-73190dab4a8c could not be found. Jan 21 09:46:40.455953 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-20691770-3c83-4c3c-b3ea-575f32fa2269 tempest-VolumesNegativeTest-107566329 tempest-VolumesNegativeTest-107566329-project] Returning 404 to user: Instance 1b2c2e3a-393a-4352-afc8-73190dab4a8c could not be found. {{(pid=123386) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 21 09:46:40.456838 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-20691770-3c83-4c3c-b3ea-575f32fa2269 tempest-VolumesNegativeTest-107566329 tempest-VolumesNegativeTest-107566329-project] 10.222.0.45 "GET /compute/v2.1/servers/1b2c2e3a-393a-4352-afc8-73190dab4a8c" status: 404 len: 111 microversion: 2.1 time: 0.030708 Jan 21 09:46:40.457449 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 622/1249] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:46:40 2022] GET /compute/v2.1/servers/1b2c2e3a-393a-4352-afc8-73190dab4a8c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 21 09:46:40.789507 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [req-6d020e05-b26e-4946-a90f-2ffbad54806b req-10a768a9-824a-4581-8ef5-ebf5c04493f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "325f56a1-8c36-43e5-9896-52f6713a7ba0", "name": "network-vif-deleted", "tag": "8a2eff4f-a260-4ac8-8540-0f38c10b4796"}]} {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:46:40.791166 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 21 09:46:40.791166 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: warnings.warn(msg) Jan 21 09:46:40.803106 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [req-6d020e05-b26e-4946-a90f-2ffbad54806b req-10a768a9-824a-4581-8ef5-ebf5c04493f1 service nova] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:46:40.804035 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [req-6d020e05-b26e-4946-a90f-2ffbad54806b req-10a768a9-824a-4581-8ef5-ebf5c04493f1 service nova] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:46:40.821808 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-b7affabb-a93d-4a6b-b76b-4c4e71469016 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:46:40.822827 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-b7affabb-a93d-4a6b-b76b-4c4e71469016 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] [instance: f4a4e6b7-47b1-4de2-8677-4f8e3eb056c2] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:46:40.827026 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.compute.server_external_events [req-6d020e05-b26e-4946-a90f-2ffbad54806b req-10a768a9-824a-4581-8ef5-ebf5c04493f1 service nova] Creating event network-vif-deleted:8a2eff4f-a260-4ac8-8540-0f38c10b4796 for instance 325f56a1-8c36-43e5-9896-52f6713a7ba0 on hv-cinder-80403 Jan 21 09:46:40.832691 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-b7affabb-a93d-4a6b-b76b-4c4e71469016 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:46:40.833497 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-b7affabb-a93d-4a6b-b76b-4c4e71469016 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:46:40.834811 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-b7affabb-a93d-4a6b-b76b-4c4e71469016 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:46:40.835533 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-b7affabb-a93d-4a6b-b76b-4c4e71469016 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:46:40.836062 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [req-6d020e05-b26e-4946-a90f-2ffbad54806b req-10a768a9-824a-4581-8ef5-ebf5c04493f1 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049632 Jan 21 09:46:40.837176 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 628/1250] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Jan 21 09:46:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 09:46:40.851088 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.wsgi [None req-b7affabb-a93d-4a6b-b76b-4c4e71469016 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] HTTP exception thrown: Instance f4a4e6b7-47b1-4de2-8677-4f8e3eb056c2 could not be found. Jan 21 09:46:40.851690 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-b7affabb-a93d-4a6b-b76b-4c4e71469016 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Returning 404 to user: Instance f4a4e6b7-47b1-4de2-8677-4f8e3eb056c2 could not be found. {{(pid=123386) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 21 09:46:40.852532 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-b7affabb-a93d-4a6b-b76b-4c4e71469016 tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] 10.222.0.45 "GET /compute/v2.1/servers/f4a4e6b7-47b1-4de2-8677-4f8e3eb056c2" status: 404 len: 111 microversion: 2.1 time: 0.037319 Jan 21 09:46:40.853091 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 623/1251] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:46:40 2022] GET /compute/v2.1/servers/f4a4e6b7-47b1-4de2-8677-4f8e3eb056c2 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 21 09:46:40.890224 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-07b0b39c-94d9-452c-ac80-1fcc60a4a60c tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:46:40.890943 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-07b0b39c-94d9-452c-ac80-1fcc60a4a60c tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] [instance: 325f56a1-8c36-43e5-9896-52f6713a7ba0] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:46:40.897576 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-07b0b39c-94d9-452c-ac80-1fcc60a4a60c tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:46:40.908507 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-07b0b39c-94d9-452c-ac80-1fcc60a4a60c tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:46:40.908507 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-07b0b39c-94d9-452c-ac80-1fcc60a4a60c tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:46:40.908507 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-07b0b39c-94d9-452c-ac80-1fcc60a4a60c tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:46:40.913929 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.wsgi [None req-07b0b39c-94d9-452c-ac80-1fcc60a4a60c tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] HTTP exception thrown: Instance 325f56a1-8c36-43e5-9896-52f6713a7ba0 could not be found. Jan 21 09:46:40.914532 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-07b0b39c-94d9-452c-ac80-1fcc60a4a60c tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Returning 404 to user: Instance 325f56a1-8c36-43e5-9896-52f6713a7ba0 could not be found. {{(pid=123387) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 21 09:46:40.915368 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-07b0b39c-94d9-452c-ac80-1fcc60a4a60c tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] 10.222.0.45 "GET /compute/v2.1/servers/325f56a1-8c36-43e5-9896-52f6713a7ba0" status: 404 len: 111 microversion: 2.1 time: 0.029318 Jan 21 09:46:40.915929 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 629/1252] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:46:40 2022] GET /compute/v2.1/servers/325f56a1-8c36-43e5-9896-52f6713a7ba0 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 21 09:46:41.184706 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-a932464d-319b-411d-8d49-8d3b6a2e974e tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] Calling method '.version_select at 0x7fb6c2c109d0>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:46:41.280666 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-a932464d-319b-411d-8d49-8d3b6a2e974e tempest-TestShelveInstance-588492181 tempest-TestShelveInstance-588492181-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-476819569" status: 202 len: 0 microversion: 2.1 time: 0.100103 Jan 21 09:46:41.281668 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 624/1253] 10.222.0.45 () {58 vars in 1250 bytes} [Fri Jan 21 09:46:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-476819569 => generated 0 bytes in 102 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 21 09:46:45.245760 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-35cbf852-e1fd-4889-af67-1821427b78d5 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:46:45.246578 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-35cbf852-e1fd-4889-af67-1821427b78d5 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] [instance: ef1ba7db-0bbf-44d8-ab58-f85d9194ecd6] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:46:45.255443 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [req-26269814-0103-419d-afe1-ea256e6d2fe2 req-40d10cd3-481c-487b-8a79-bd28c3461153 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ef1ba7db-0bbf-44d8-ab58-f85d9194ecd6", "tag": "23ca9b58-bb47-447e-9704-d2768396690b"}]} {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:46:45.264461 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 21 09:46:45.264461 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: warnings.warn(msg) Jan 21 09:46:45.271144 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-35cbf852-e1fd-4889-af67-1821427b78d5 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:46:45.275085 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-35cbf852-e1fd-4889-af67-1821427b78d5 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:46:45.277107 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-35cbf852-e1fd-4889-af67-1821427b78d5 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:46:45.279996 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-35cbf852-e1fd-4889-af67-1821427b78d5 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:46:45.287322 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [req-26269814-0103-419d-afe1-ea256e6d2fe2 req-40d10cd3-481c-487b-8a79-bd28c3461153 service nova] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:46:45.288074 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [req-26269814-0103-419d-afe1-ea256e6d2fe2 req-40d10cd3-481c-487b-8a79-bd28c3461153 service nova] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:46:45.356323 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.compute.server_external_events [req-26269814-0103-419d-afe1-ea256e6d2fe2 req-40d10cd3-481c-487b-8a79-bd28c3461153 service nova] Creating event network-changed:23ca9b58-bb47-447e-9704-d2768396690b for instance ef1ba7db-0bbf-44d8-ab58-f85d9194ecd6 on hv-cinder-80403 Jan 21 09:46:45.359213 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-35cbf852-e1fd-4889-af67-1821427b78d5 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] [instance: ef1ba7db-0bbf-44d8-ab58-f85d9194ecd6] Going to try to terminate instance {{(pid=123387) delete /opt/stack/nova/nova/compute/api.py:2614}} Jan 21 09:46:45.380613 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [req-26269814-0103-419d-afe1-ea256e6d2fe2 req-40d10cd3-481c-487b-8a79-bd28c3461153 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.134033 Jan 21 09:46:45.386394 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 625/1254] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Jan 21 09:46:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 09:46:45.852272 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-35cbf852-e1fd-4889-af67-1821427b78d5 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] 10.222.0.45 "DELETE /compute/v2.1/servers/ef1ba7db-0bbf-44d8-ab58-f85d9194ecd6" status: 204 len: 0 microversion: 2.1 time: 0.612109 Jan 21 09:46:45.858020 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 630/1255] 10.222.0.45 () {58 vars in 1238 bytes} [Fri Jan 21 09:46:45 2022] DELETE /compute/v2.1/servers/ef1ba7db-0bbf-44d8-ab58-f85d9194ecd6 => generated 0 bytes in 616 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jan 21 09:46:45.866438 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-d5ea6a6d-a5ab-4aae-8d4d-6927380c6ec5 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:46:45.868047 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-d5ea6a6d-a5ab-4aae-8d4d-6927380c6ec5 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] [instance: ef1ba7db-0bbf-44d8-ab58-f85d9194ecd6] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:46:45.880541 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-d5ea6a6d-a5ab-4aae-8d4d-6927380c6ec5 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:46:45.881698 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-d5ea6a6d-a5ab-4aae-8d4d-6927380c6ec5 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:46:45.883581 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-d5ea6a6d-a5ab-4aae-8d4d-6927380c6ec5 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:46:45.884645 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-d5ea6a6d-a5ab-4aae-8d4d-6927380c6ec5 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:46:46.568159 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.policy [None req-d5ea6a6d-a5ab-4aae-8d4d-6927380c6ec5 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d53a7fa2cb5498aa916817b82dba77e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515ded26ca114fbf9c6e920362aec64c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123386) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:46:46.583999 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-d5ea6a6d-a5ab-4aae-8d4d-6927380c6ec5 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] 10.222.0.45 "GET /compute/v2.1/servers/ef1ba7db-0bbf-44d8-ab58-f85d9194ecd6" status: 200 len: 1575 microversion: 2.1 time: 0.723976 Jan 21 09:46:46.588054 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 626/1256] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:46:45 2022] GET /compute/v2.1/servers/ef1ba7db-0bbf-44d8-ab58-f85d9194ecd6 => generated 1575 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 09:46:47.606373 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-7f1b9683-52f7-481c-9cec-bbd4ccf21429 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:46:47.607119 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-7f1b9683-52f7-481c-9cec-bbd4ccf21429 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] [instance: ef1ba7db-0bbf-44d8-ab58-f85d9194ecd6] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:46:47.615260 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-7f1b9683-52f7-481c-9cec-bbd4ccf21429 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:46:47.615704 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-7f1b9683-52f7-481c-9cec-bbd4ccf21429 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:46:47.616714 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-7f1b9683-52f7-481c-9cec-bbd4ccf21429 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:46:47.617172 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-7f1b9683-52f7-481c-9cec-bbd4ccf21429 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:46:47.952870 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-7f1b9683-52f7-481c-9cec-bbd4ccf21429 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d53a7fa2cb5498aa916817b82dba77e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515ded26ca114fbf9c6e920362aec64c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:46:47.963178 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-7f1b9683-52f7-481c-9cec-bbd4ccf21429 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] 10.222.0.45 "GET /compute/v2.1/servers/ef1ba7db-0bbf-44d8-ab58-f85d9194ecd6" status: 200 len: 1457 microversion: 2.1 time: 0.361303 Jan 21 09:46:47.963896 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 631/1257] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:46:47 2022] GET /compute/v2.1/servers/ef1ba7db-0bbf-44d8-ab58-f85d9194ecd6 => generated 1457 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jan 21 09:46:48.400147 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [req-d4a46eea-fe36-4a04-95ca-f81dab1298a1 req-9a1cda06-cf65-430b-a0e1-cdd0e30a4fba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef1ba7db-0bbf-44d8-ab58-f85d9194ecd6", "name": "network-vif-deleted", "tag": "23ca9b58-bb47-447e-9704-d2768396690b"}]} {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jan 21 09:46:48.401808 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jan 21 09:46:48.401808 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: warnings.warn(msg) Jan 21 09:46:48.410666 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [req-d4a46eea-fe36-4a04-95ca-f81dab1298a1 req-9a1cda06-cf65-430b-a0e1-cdd0e30a4fba service nova] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:46:48.411386 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [req-d4a46eea-fe36-4a04-95ca-f81dab1298a1 req-9a1cda06-cf65-430b-a0e1-cdd0e30a4fba service nova] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:46:48.424596 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.compute.server_external_events [req-d4a46eea-fe36-4a04-95ca-f81dab1298a1 req-9a1cda06-cf65-430b-a0e1-cdd0e30a4fba service nova] Creating event network-vif-deleted:23ca9b58-bb47-447e-9704-d2768396690b for instance ef1ba7db-0bbf-44d8-ab58-f85d9194ecd6 on hv-cinder-80403 Jan 21 09:46:48.435056 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [req-d4a46eea-fe36-4a04-95ca-f81dab1298a1 req-9a1cda06-cf65-430b-a0e1-cdd0e30a4fba service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034797 Jan 21 09:46:48.435056 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 627/1258] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Jan 21 09:46:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jan 21 09:46:48.996555 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-d45bca4a-1107-44e4-a40e-adb03a463b40 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:46:48.997731 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-d45bca4a-1107-44e4-a40e-adb03a463b40 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] [instance: ef1ba7db-0bbf-44d8-ab58-f85d9194ecd6] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:46:49.009966 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-d45bca4a-1107-44e4-a40e-adb03a463b40 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:46:49.010771 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-d45bca4a-1107-44e4-a40e-adb03a463b40 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:46:49.012223 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-d45bca4a-1107-44e4-a40e-adb03a463b40 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:46:49.013031 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-d45bca4a-1107-44e4-a40e-adb03a463b40 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:46:49.093226 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.policy [None req-d45bca4a-1107-44e4-a40e-adb03a463b40 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d53a7fa2cb5498aa916817b82dba77e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '515ded26ca114fbf9c6e920362aec64c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123387) authorize /opt/stack/nova/nova/policy.py:199}} Jan 21 09:46:49.107552 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-d45bca4a-1107-44e4-a40e-adb03a463b40 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] 10.222.0.45 "GET /compute/v2.1/servers/ef1ba7db-0bbf-44d8-ab58-f85d9194ecd6" status: 200 len: 1224 microversion: 2.1 time: 0.120248 Jan 21 09:46:49.108322 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 632/1259] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:46:48 2022] GET /compute/v2.1/servers/ef1ba7db-0bbf-44d8-ab58-f85d9194ecd6 => generated 1224 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jan 21 09:46:50.133873 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-b76fc807-5c52-4294-b41a-4567baded6bd tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:46:50.134867 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-b76fc807-5c52-4294-b41a-4567baded6bd tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] [instance: ef1ba7db-0bbf-44d8-ab58-f85d9194ecd6] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:46:50.147279 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-b76fc807-5c52-4294-b41a-4567baded6bd tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:46:50.148112 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-b76fc807-5c52-4294-b41a-4567baded6bd tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:46:50.149730 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-b76fc807-5c52-4294-b41a-4567baded6bd tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:46:50.150785 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-b76fc807-5c52-4294-b41a-4567baded6bd tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:46:50.186968 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.wsgi [None req-b76fc807-5c52-4294-b41a-4567baded6bd tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] HTTP exception thrown: Instance ef1ba7db-0bbf-44d8-ab58-f85d9194ecd6 could not be found. Jan 21 09:46:50.187128 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-b76fc807-5c52-4294-b41a-4567baded6bd tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Returning 404 to user: Instance ef1ba7db-0bbf-44d8-ab58-f85d9194ecd6 could not be found. {{(pid=123386) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 21 09:46:50.189435 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-b76fc807-5c52-4294-b41a-4567baded6bd tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] 10.222.0.45 "GET /compute/v2.1/servers/ef1ba7db-0bbf-44d8-ab58-f85d9194ecd6" status: 404 len: 111 microversion: 2.1 time: 0.058929 Jan 21 09:46:50.193560 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 628/1260] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:46:50 2022] GET /compute/v2.1/servers/ef1ba7db-0bbf-44d8-ab58-f85d9194ecd6 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 21 09:46:51.086039 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-3be884f1-aa14-4048-8421-b5c88c9e29f9 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Calling method '>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:46:51.086793 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.compute.api [None req-3be884f1-aa14-4048-8421-b5c88c9e29f9 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] [instance: 2733931f-f68e-4f48-85d2-5060a8f55eec] Fetching instance by UUID {{(pid=123387) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:46:51.094456 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-3be884f1-aa14-4048-8421-b5c88c9e29f9 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:46:51.095141 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-3be884f1-aa14-4048-8421-b5c88c9e29f9 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:46:51.096736 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-3be884f1-aa14-4048-8421-b5c88c9e29f9 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:46:51.096736 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG oslo_concurrency.lockutils [None req-3be884f1-aa14-4048-8421-b5c88c9e29f9 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123387) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:46:51.121103 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.wsgi [None req-3be884f1-aa14-4048-8421-b5c88c9e29f9 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] HTTP exception thrown: Instance 2733931f-f68e-4f48-85d2-5060a8f55eec could not be found. Jan 21 09:46:51.125035 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-3be884f1-aa14-4048-8421-b5c88c9e29f9 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Returning 404 to user: Instance 2733931f-f68e-4f48-85d2-5060a8f55eec could not be found. {{(pid=123387) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 21 09:46:51.127714 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-3be884f1-aa14-4048-8421-b5c88c9e29f9 tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] 10.222.0.45 "DELETE /compute/v2.1/servers/2733931f-f68e-4f48-85d2-5060a8f55eec" status: 404 len: 111 microversion: 2.1 time: 0.043721 Jan 21 09:46:51.134321 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 633/1261] 10.222.0.45 () {58 vars in 1238 bytes} [Fri Jan 21 09:46:51 2022] DELETE /compute/v2.1/servers/2733931f-f68e-4f48-85d2-5060a8f55eec => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jan 21 09:46:51.144360 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-cbd6d9a0-5b1d-4bb2-8492-33c4558653cf tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Calling method '>' {{(pid=123386) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:46:51.145972 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.compute.api [None req-cbd6d9a0-5b1d-4bb2-8492-33c4558653cf tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] [instance: 2733931f-f68e-4f48-85d2-5060a8f55eec] Fetching instance by UUID {{(pid=123386) get /opt/stack/nova/nova/compute/api.py:2865}} Jan 21 09:46:51.153342 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-cbd6d9a0-5b1d-4bb2-8492-33c4558653cf tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:46:51.154007 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-cbd6d9a0-5b1d-4bb2-8492-33c4558653cf tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:46:51.154961 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-cbd6d9a0-5b1d-4bb2-8492-33c4558653cf tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jan 21 09:46:51.155719 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG oslo_concurrency.lockutils [None req-cbd6d9a0-5b1d-4bb2-8492-33c4558653cf tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Lock "e6c51752-00e2-49a2-b378-b2153f241200" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123386) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jan 21 09:46:51.175204 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.wsgi [None req-cbd6d9a0-5b1d-4bb2-8492-33c4558653cf tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] HTTP exception thrown: Instance 2733931f-f68e-4f48-85d2-5060a8f55eec could not be found. Jan 21 09:46:51.176085 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: DEBUG nova.api.openstack.wsgi [None req-cbd6d9a0-5b1d-4bb2-8492-33c4558653cf tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Returning 404 to user: Instance 2733931f-f68e-4f48-85d2-5060a8f55eec could not be found. {{(pid=123386) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Jan 21 09:46:51.177297 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO nova.api.openstack.requestlog [None req-cbd6d9a0-5b1d-4bb2-8492-33c4558653cf tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] 10.222.0.45 "GET /compute/v2.1/servers/2733931f-f68e-4f48-85d2-5060a8f55eec" status: 404 len: 111 microversion: 2.1 time: 0.040819 Jan 21 09:46:51.178283 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: [pid: 123386|app: 0|req: 629/1262] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jan 21 09:46:51 2022] GET /compute/v2.1/servers/2733931f-f68e-4f48-85d2-5060a8f55eec => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jan 21 09:46:52.886006 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: DEBUG nova.api.openstack.wsgi [None req-a2193745-fee7-4b92-9f11-2d76765b486f tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] Calling method '.version_select at 0x7fb6c2d64b80>' {{(pid=123387) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jan 21 09:46:52.990096 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO nova.api.openstack.requestlog [None req-a2193745-fee7-4b92-9f11-2d76765b486f tempest-TestVolumeBootPattern-1119423900 tempest-TestVolumeBootPattern-1119423900-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-772796190" status: 202 len: 0 microversion: 2.1 time: 0.111787 Jan 21 09:46:52.990696 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: [pid: 123387|app: 0|req: 634/1263] 10.222.0.45 () {58 vars in 1259 bytes} [Fri Jan 21 09:46:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-772796190 => generated 0 bytes in 114 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jan 21 09:47:29.778445 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 21 09:47:29.779127 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: Fri Jan 21 09:47:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 21 09:49:09.944283 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 21 09:49:09.944877 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: Fri Jan 21 09:49:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 21 09:49:14.748541 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 21 09:49:14.749285 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: Fri Jan 21 09:49:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 21 09:49:30.194558 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 21 09:49:30.195235 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: Fri Jan 21 09:49:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 21 09:49:32.593693 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 21 09:49:32.594276 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: Fri Jan 21 09:49:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 21 09:50:49.787888 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 21 09:50:49.788756 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: Fri Jan 21 09:50:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 21 09:51:56.469052 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 21 09:51:56.469925 dv-cinder-804035-25-iscsi devstack@n-api.service[123386]: Fri Jan 21 09:51:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 21 09:52:29.952631 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 21 09:52:29.953243 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: Fri Jan 21 09:52:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jan 21 09:52:34.758350 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jan 21 09:52:34.758973 dv-cinder-804035-25-iscsi devstack@n-api.service[123387]: Fri Jan 21 09:52:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!